-- Logs begin at Tue 2022-08-02 08:08:12 UTC, end at Tue 2022-08-02 09:30:30 UTC. -- Aug 02 09:00:47.836447 dv-cinder-845990-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 02 09:00:47.847842 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 02 09:00:47.847842 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 09:00:47 2022] *** Aug 02 09:00:47.847842 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 09:00:47.847842 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 09:00:47.847842 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: nodename: dv-cinder-845990-6-iscsi Aug 02 09:00:47.847842 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: machine: x86_64 Aug 02 09:00:47.847842 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: clock source: unix Aug 02 09:00:47.847842 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: pcre jit disabled Aug 02 09:00:47.847842 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: detected number of CPU cores: 4 Aug 02 09:00:47.847842 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: current working directory: / Aug 02 09:00:47.847842 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: detected binary path: /usr/bin/uwsgi-core Aug 02 09:00:47.847842 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: your processes number limit is 47680 Aug 02 09:00:47.847842 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: your memory page size is 4096 bytes Aug 02 09:00:47.847842 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: detected max file descriptor number: 2048 Aug 02 09:00:47.847842 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: lock engine: pthread robust mutexes Aug 02 09:00:47.847842 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: thunder lock: enabled Aug 02 09:00:47.849496 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 02 09:00:47.849496 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 09:00:47.889588 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: Python main interpreter initialized at 0x55ce312179c0 Aug 02 09:00:47.889588 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: python threads support enabled Aug 02 09:00:47.889588 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: your server socket listen backlog is limited to 100 connections Aug 02 09:00:47.889588 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: your mercy for graceful operations on workers is 90 seconds Aug 02 09:00:47.890013 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 09:00:47.890013 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: *** Operational MODE: preforking *** Aug 02 09:00:47.890321 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: *** uWSGI is running in multiple interpreter mode *** Aug 02 09:00:47.890321 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: spawned uWSGI master process (pid: 103974) Aug 02 09:00:47.890540 dv-cinder-845990-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 02 09:00:47.891708 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: spawned uWSGI worker 1 (pid: 103975, cores: 1) Aug 02 09:00:47.891708 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: spawned uWSGI worker 2 (pid: 103976, cores: 1) Aug 02 09:00:47.891708 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 09:00:48.577988 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 09:00:48.579683 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 09:00:49.690838 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:00:49.690838 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: from cryptography.utils import int_from_bytes Aug 02 09:00:49.691594 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:00:49.691594 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: from cryptography.utils import int_from_bytes Aug 02 09:00:49.691594 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:00:49.691594 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: from cryptography.utils import int_from_bytes Aug 02 09:00:49.692152 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:00:49.692152 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: from cryptography.utils import int_from_bytes Aug 02 09:00:52.261054 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 09:00:52.261754 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 09:00:52.261908 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 09:00:52.262026 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 09:00:52.262451 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 09:00:52.262552 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 09:00:52.262649 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 09:00:52.262797 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.262887 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 09:00:52.263124 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.263225 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 09:00:52.263392 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 09:00:52.263491 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.263749 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.263844 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.264077 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.264201 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.264421 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.264529 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.264735 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.264829 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.265051 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.265145 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.265355 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.265449 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.265626 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.265718 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.265940 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.266032 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.266266 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845990-6-iscsi {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.266359 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.266523 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.266619 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.266837 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.266980 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.267170 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845990-6-iscsi {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.267277 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.267471 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.267573 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.267773 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.267882 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.268080 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.268226 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.268407 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.268500 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.268710 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.268906 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.269026 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.269316 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.269483 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.269638 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.269816 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.269997 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.270181 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.270332 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.270488 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.270665 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.270813 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.270954 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.271090 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.271214 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.271343 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.271475 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.271684 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.271859 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.272102 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.272273 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.272648 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845990-6-iscsi {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.272750 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.272983 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.273083 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.273302 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.273411 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.273623 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.273726 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845990-6-iscsi {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.274004 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.274192 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.274320 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.274421 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.274629 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.274758 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.275113 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.275235 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.275326 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.275413 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.275571 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.275751 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.275906 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.276062 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.276226 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.276387 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.276541 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.276679 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.276838 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.276958 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.277137 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.277236 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.277441 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.277527 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.277759 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.277890 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.278476 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.278563 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.278640 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.278727 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.278815 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.278888 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.278888 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.279018 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.279175 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.279261 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.279495 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.279582 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.279737 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.279839 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.280040 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.280133 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.280386 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.280495 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.280638 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.280736 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.280958 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.281047 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.281239 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.281335 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.281485 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.281573 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.281798 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.281895 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.282115 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.282215 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.282443 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.282610 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.282746 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.282822 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.283047 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.283132 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.283353 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.283456 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.283658 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.283742 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.283979 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.284063 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.284321 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.284411 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.284621 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.284724 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.284935 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.285030 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.285248 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.285347 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.285565 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.285673 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.285869 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.285975 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.286175 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.286261 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.286516 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.286606 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.286798 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.286893 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.287627 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.287770 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.288092 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.288219 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.288518 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.288652 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.288833 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.288967 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.289144 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.289288 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.289527 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.289627 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.289781 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.289901 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.290117 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.290215 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.290423 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.290518 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.290674 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.290797 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.290978 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.291113 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.291285 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.291413 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.291605 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.291699 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.291918 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.292016 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.292243 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.292365 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.292554 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.292659 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.292853 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.292953 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.293155 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.293250 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.293463 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.293564 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.293756 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.293852 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.294056 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.294143 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.294368 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.294524 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.294662 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.294752 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.294969 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.295085 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.295272 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.295367 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.295570 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.295663 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.295872 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.295965 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.296184 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.296293 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.296492 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.296591 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.296796 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.296886 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.297102 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.297209 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.297400 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.297491 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.297702 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.297798 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.298009 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.298111 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.298309 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.298408 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.298623 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.298716 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.298927 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.299027 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.299230 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.299337 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.299539 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.299645 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.299840 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.299938 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.300153 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.300268 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.300475 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.300570 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.300779 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.300900 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.301073 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.301168 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.301384 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.301471 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.301679 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.301780 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.302010 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.302111 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.302302 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.302389 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.302573 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.302671 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.303493 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.303614 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.303851 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.304036 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.304272 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.304447 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.304585 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.304750 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.304892 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.305059 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.305218 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.305360 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.305542 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.305662 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.305854 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.305962 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.306165 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.306261 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.306472 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.306572 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.306794 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.306882 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.307135 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.307223 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.307446 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.307531 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.307759 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:00:52.307864 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.308098 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.308231 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.308453 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.308547 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.308782 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.308878 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.309094 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.309214 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.309400 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.309486 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.309720 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.309871 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.310032 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.310122 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.310340 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.310435 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.310647 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.310744 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.310961 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.311047 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.311266 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.311358 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.311573 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.311661 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.311880 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.311968 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.312221 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.312336 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.312537 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.312633 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.312853 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.312941 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.313161 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.313247 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.313474 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.313571 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.313788 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.313875 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.314095 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.314182 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.314405 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.314494 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.314728 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.314828 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.315043 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.315130 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.315349 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.315438 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.315682 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.315769 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.316003 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.316090 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.316342 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.316431 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.316657 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.316744 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.316969 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.317066 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.317277 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.317373 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.317584 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.317681 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.317895 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.317993 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.318215 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.318550 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.318658 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.318749 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.318938 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.319185 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.319432 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.319532 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.319751 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.319839 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.320074 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.320230 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.320432 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.320534 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.320743 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.320831 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.321053 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.321149 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.321365 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.321456 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.321683 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.321769 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.321993 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.322071 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.322310 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.322412 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.322614 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.322702 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.322919 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.323008 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.323222 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.323308 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.323524 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.323618 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.323825 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.323930 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.324126 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.324236 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.324452 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.324555 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.324758 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.324855 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.325056 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.325144 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.325370 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.325469 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.325691 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.325779 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.325993 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.326088 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.326302 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.326438 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.326609 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.326708 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.326912 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.326999 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.327213 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.327312 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.327516 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.327612 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.327815 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.327904 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.328126 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.328270 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.328461 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.328587 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.328757 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.328853 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.329079 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.329191 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.329388 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.329500 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.329696 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.329803 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.330019 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.330119 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.330332 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.330423 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.330645 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.330739 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.330958 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.331051 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.331271 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.331359 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.331574 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.331670 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.331882 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.331969 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.332207 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.332299 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.332530 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.332637 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.332839 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.332927 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.333148 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.333235 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.333471 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.333567 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.333792 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.333885 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.334147 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.334250 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.334555 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.334745 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.334868 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.335083 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.335170 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.335399 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.335553 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.335703 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.335793 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.336008 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.336098 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.336335 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.336443 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.336810 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.336900 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.337020 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.337097 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.337223 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.337314 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.337522 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.337622 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.337822 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.337918 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.338127 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.338224 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.338429 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.338516 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.338729 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.338822 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.339027 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.339116 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.339407 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.339507 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.339704 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.339791 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.340003 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.340093 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.340327 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.340420 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.340665 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.340754 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.340965 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.341064 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.341300 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.341397 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.341623 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.341709 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.341934 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.342028 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.342244 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.342330 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.342553 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.342670 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.342859 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.342946 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.343162 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.343279 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.343467 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.343564 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.343772 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.343860 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.344080 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.344211 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.344433 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.344534 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.344744 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.344839 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.345065 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.345152 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.345372 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.345468 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.345687 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.345777 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.345991 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.346079 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.346314 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.346414 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.346614 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.346701 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.346925 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.347019 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.347250 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.347338 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.347565 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.347652 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.347876 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.347970 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.348206 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.348313 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.348517 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.348603 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.348825 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.348912 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.349131 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.349219 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.349437 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.349525 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.350285 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.350387 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.350598 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.350866 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.350953 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.351217 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.351311 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.351536 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.351636 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.351841 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.351928 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.352196 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.352289 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.352506 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.352596 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.352818 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.352912 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.353136 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.353223 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.353435 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.353522 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.353756 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.353842 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.354329 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.354433 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.354634 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.354944 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.355248 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.355505 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.355604 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.355821 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.355917 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.356135 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.356250 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.356478 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.356565 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.356787 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.356884 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.357091 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.357177 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.357398 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.357497 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.357700 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.357794 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.358002 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.358090 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.358306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.358391 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.358619 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.358713 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.358927 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.359060 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.359234 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.359321 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.359537 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.359626 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.359845 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.359938 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.360150 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.360289 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.360476 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.360619 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.360776 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.360865 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.361083 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.361179 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.361388 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.361473 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.361694 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.361781 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.362001 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.362107 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.362313 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.362399 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.362616 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.362711 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.362914 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.363009 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.363230 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.363317 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.363533 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.363628 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.363834 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.363930 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.364132 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.364291 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.364461 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.364582 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.364768 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.364865 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.365089 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.365182 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.365457 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.365553 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.365770 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.366083 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.366175 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.366398 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.366485 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.366709 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.366805 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.367023 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.367117 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.367347 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.367446 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.367653 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.367740 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.367970 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.368072 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.368298 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.368389 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.368602 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.368690 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.368911 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.369049 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.369219 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.369308 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.369528 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.369798 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.369906 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.370137 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.370249 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.370443 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.370585 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.370750 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.370840 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.371055 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.371154 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.371358 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.371446 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.371664 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.371752 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.371977 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.372064 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.372371 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.372571 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.372695 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.372898 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.372986 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.373210 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.373298 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.373525 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.373613 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.373843 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.373976 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.374145 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.374231 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.374451 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.374550 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.374758 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.374867 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.375065 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.375152 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.375370 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.375472 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.375671 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.375758 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.375970 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.376058 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.376298 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.376410 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.376606 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.376695 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.376905 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.376992 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.377204 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.377367 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.377502 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.377591 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.377805 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.377892 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.378107 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.378209 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.378401 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.378490 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.378702 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.378788 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.378998 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.379124 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.379307 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.379386 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.379610 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.379733 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.379913 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.380028 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.380237 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.380377 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.380557 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.380733 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.381650 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.381898 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.381898 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.382122 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.382237 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.382362 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.382470 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.382752 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.382877 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.383125 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.383237 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.383433 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.383774 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.384102 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.384469 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.384618 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.384773 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.385080 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.385400 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.385698 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.386005 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.386305 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.386452 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.386600 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.386722 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.386893 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.387037 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.387189 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.387598 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.387953 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.397021 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.397183 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.397716 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.397829 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.397915 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.398000 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.398080 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.398080 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.398226 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.398307 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.398395 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.398476 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.398555 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.398634 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.398720 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.398800 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.398892 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.398972 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.399051 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.399176 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.399272 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.399366 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.399456 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.399534 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.399620 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.399700 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.399778 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.399865 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.399946 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.400031 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.400112 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.400229 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.400229 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.400386 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.400476 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.400556 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.400634 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.400711 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.400789 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.400924 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.401063 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.401148 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.401228 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.401313 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.401402 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.401484 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.401575 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.401669 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.401751 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.401837 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.401932 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.402014 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.402100 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.402180 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.402259 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.402426 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.402618 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.402736 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.402736 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.402891 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.402979 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.403061 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.403149 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.403225 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.403293 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.403359 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.403423 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.403495 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.403577 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.403656 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.403731 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.403798 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.403876 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.403969 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.404049 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.404135 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.404285 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.404371 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.404450 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.404548 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.404638 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.404718 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.404796 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.404874 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.404948 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.405023 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.405115 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.405198 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.405308 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.405390 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.405479 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.405560 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.405666 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.405666 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.405827 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.405915 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.406004 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.406093 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.406174 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.406241 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.406315 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.406315 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.406443 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.406523 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.406601 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.406687 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.406768 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.406846 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.406960 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.406960 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.407131 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.407200 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.407200 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.407343 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.407432 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.407499 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.407564 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.407641 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.407727 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.407727 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.407872 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.407938 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.408003 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.408067 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.408145 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.408314 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.408459 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.408780 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.408868 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.409108 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.409433 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.409610 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.409764 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.409999 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.410087 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.410379 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.410585 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.410698 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.410990 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.411115 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.411304 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.411459 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.411618 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.411836 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.411924 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.412921 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.413030 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.413150 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.413257 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.413467 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.413708 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.413811 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.414034 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.414122 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.414354 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.414444 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.414672 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.414760 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.414979 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.415065 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.415302 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.415397 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.415611 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.415705 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.415919 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.416016 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.416250 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.416341 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.416558 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.416644 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.416867 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.416966 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.417172 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.417266 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.417501 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.417630 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.417808 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.417911 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.418115 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.418206 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.418422 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.418510 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.418728 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.418835 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.419043 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.419131 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.419347 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.419443 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.419709 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.419797 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.420018 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.420105 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.420415 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.420566 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.420717 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.420808 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.421015 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.421156 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.421328 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.421420 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.421641 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.421737 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.421949 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.422036 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.422252 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.422340 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.422576 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.422663 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.422886 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.422973 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.423194 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.423290 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.423505 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.423605 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.423838 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.423965 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.424142 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.424328 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.424472 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.424561 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.424793 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.424888 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.425097 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.425198 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.425402 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.425504 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.425702 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.425897 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.426021 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.426214 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.426326 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.426529 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.426646 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.426855 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.427056 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.427183 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.427365 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.427512 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.427669 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.428464 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.428844 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.428971 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.429160 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.429487 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.429590 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.429816 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.430044 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.430146 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.430348 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.430438 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.430686 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.430834 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.431011 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.431100 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.431321 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.431418 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.431638 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.431726 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.431950 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.432040 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.432307 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.432412 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.432626 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.432727 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.432945 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.433086 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.433259 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.433347 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.433565 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.433653 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.433899 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.433999 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.434210 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.434308 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.434522 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.434610 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.434843 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.434940 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.435151 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.435242 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.435486 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.435590 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.435787 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.435885 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.436103 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.436223 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.436448 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.436541 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.436762 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.436851 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.437087 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.437188 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.437370 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.437457 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.437673 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.437762 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.437979 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.438075 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.438300 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.438386 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.438604 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.438742 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.438931 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.439030 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.439238 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.439326 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.439548 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.439656 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.439847 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.439965 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.440149 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.440274 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.440480 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.440569 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.440777 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.440891 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.441081 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.441182 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.441393 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.441543 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.441713 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.441802 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.442030 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.442126 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.442329 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.442416 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.442647 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.442735 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.442953 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.443049 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.443253 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.443365 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.443661 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.443748 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.443981 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.444312 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.444414 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.444624 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.444715 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.444931 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.445028 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.445238 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.445334 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.445555 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.445688 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.445859 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.445958 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.446166 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.446254 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.446471 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.446559 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.446780 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.446870 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.447082 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.447177 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.447396 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.447509 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.447695 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.447793 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.447999 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.448146 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.448375 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.448467 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.448705 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.448841 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.449012 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.449128 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.449309 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.449398 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.449611 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.449708 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.449913 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.450000 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.450211 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.450308 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.450514 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.450603 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.450816 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.450904 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.451136 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.451302 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.451440 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.451519 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.451762 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.451854 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.452069 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.452191 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.452398 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.452487 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.452703 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.452792 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.453004 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.453100 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.453336 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.453422 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.453634 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.453721 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.453965 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.454060 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.454276 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.454363 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.454589 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.454676 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.454901 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.454991 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.455203 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.455290 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.455522 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.455610 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.455833 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.455922 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.456146 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.456432 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.456523 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.456769 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.456918 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.457078 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.457173 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.457389 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.457477 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.457700 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.457798 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.458006 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.458095 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.458321 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.458408 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.458629 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.458724 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.458939 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.459147 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.459295 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.459611 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.459836 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.459925 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.460224 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.460316 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.460545 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.460633 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.460859 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.460949 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.461170 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.461259 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.461485 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.461633 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.461801 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.461914 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.462116 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.462244 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.462419 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.462522 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.462728 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.462823 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.463033 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.463124 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.463359 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.463479 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.463680 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.463771 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.464004 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.464090 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.464344 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.464449 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.464660 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.464749 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.464977 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.465065 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.465286 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.465376 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.465598 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.465697 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.465911 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.466007 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.466227 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.466317 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.466541 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.466629 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.466853 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.466992 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.467166 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.467263 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.467476 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.467566 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.467784 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.467874 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.468092 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.468228 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.468434 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.468522 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.468741 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.468961 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.469049 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.469277 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.469365 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.469615 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.469712 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.469928 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.470022 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.470251 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.470346 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.470569 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.470664 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.470884 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.470970 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.471195 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.471283 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.471501 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.471590 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.471811 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.471898 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.472123 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.472370 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.472472 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.472691 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.472832 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.473026 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.473187 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.473328 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.473479 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.473651 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.473749 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.473964 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.474061 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.474270 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.474366 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.475228 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.475461 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.475705 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.475810 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.476121 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.476232 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.476478 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.476574 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.476809 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.476911 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.477128 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.477218 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.477436 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.477525 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.477743 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.477829 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.478052 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.478149 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.478357 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.478451 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.478666 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.478767 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.478976 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.479481 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.479575 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.479832 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.479921 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.480147 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.480261 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.480479 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.480566 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.480785 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.480873 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.481099 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.481190 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.481403 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.481492 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.481724 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.481866 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.482066 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.482219 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.482309 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.482531 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.482622 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.482849 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.482947 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.483158 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.483247 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.483463 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.483553 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.483767 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.483856 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.484075 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.484254 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.484407 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.484496 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.484712 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.484809 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.485016 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.485103 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.485317 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.485420 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.485639 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.485742 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.485940 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.486033 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.486241 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.486337 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.486542 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.486631 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.486850 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.486938 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.487150 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.487247 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.487451 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.487549 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.487751 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.487839 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.488057 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.488155 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.488388 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.488477 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.488688 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.488777 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.488994 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.489095 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.489294 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.489405 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.489601 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.489727 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.489902 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.490245 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.490361 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.491167 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.491255 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.491493 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.491781 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.491936 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.492095 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.492254 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.492431 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.492523 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.492751 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.492851 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.493064 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.493161 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.493387 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.493476 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.493700 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.493789 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.494008 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.494094 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.494318 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.494416 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.494636 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.494733 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.494951 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.495183 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.495273 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.495518 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.495625 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.495835 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.495932 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.496181 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.496278 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.496518 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.496616 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.496830 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.496950 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.497127 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.497260 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.497428 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.497518 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.497738 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.497825 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.498052 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.498153 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.498358 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.498448 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.498664 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.498755 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.498975 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.499072 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.499281 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.499372 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.499588 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.499676 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.499896 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.499993 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.500234 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.500382 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.500539 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.500627 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.500846 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.500946 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.501163 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.501319 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.501631 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.501741 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.501951 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.502092 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.502263 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.502355 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.502621 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.502720 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.502964 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.503059 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.503283 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.503373 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.503600 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.503697 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.503913 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.504002 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.504252 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.504346 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.504564 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.504666 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.504872 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.504961 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.505180 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.505276 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.505487 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.505585 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.505798 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.505924 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.506182 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.506357 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.506509 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.506802 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.506947 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.507122 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.507262 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.507553 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.507655 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.507867 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.507954 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.508202 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.508293 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.508528 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.508635 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.508838 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.508925 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.509145 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.509233 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.509453 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.509543 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.509761 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.509859 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.510064 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.510152 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.510696 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.510818 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.510902 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.510982 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.511116 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.511210 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.511306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.511478 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.511609 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.511803 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.511901 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.512109 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.512308 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.512439 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.512530 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.512742 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.512840 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.513050 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.513141 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.513368 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.513456 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.513677 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.513767 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.513979 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.514077 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.514278 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.514366 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.514585 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.514684 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.514883 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.514973 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.515181 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.515277 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.515481 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.515570 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.515781 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.515879 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.516085 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.516203 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.516409 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.516512 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.516709 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.516807 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.517009 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.517097 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.517308 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.517408 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.517613 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.517702 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.517913 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.518001 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.518217 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.518314 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.518515 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.518604 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.518816 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.518903 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.519113 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.519211 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.519412 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.519523 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.519709 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.519841 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.520038 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.520222 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.520393 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.520484 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.520705 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.520794 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.521025 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.521116 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.521333 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.521421 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.521787 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.521943 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.522128 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.522263 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.522456 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.522674 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.522772 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.523001 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.523092 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.523321 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.523409 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.523634 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.523724 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.523970 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.524061 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.524308 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.524400 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.524625 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.524762 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.524937 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.525025 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.525248 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.525347 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.525562 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.525664 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.525870 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.525958 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.526188 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.526275 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.526509 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.526605 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.526816 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.526911 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.527139 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.527236 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.527452 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.527548 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.527770 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.527865 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.528084 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.528216 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.528422 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.528525 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.528750 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.528839 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.529062 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.529151 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.529373 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.529464 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.529681 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.529777 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.529991 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.530088 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.530301 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.530391 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.530562 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103976) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 09:00:52.530651 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.531026 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.531341 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.531658 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.531974 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.532327 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.532655 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.532965 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.533289 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.533616 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.533961 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.534272 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.534614 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.534941 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.535253 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.535562 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.535865 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:00:52.536106 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103975) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 09:00:52.687111 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO dbcounter [None req-35dce19a-8c98-4425-a5c9-60a678b4192c None None] Registered counter for database nova_api Aug 02 09:00:52.696630 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO dbcounter [None req-c8df3740-51e0-4338-98b6-ef14276d7910 None None] Registered counter for database nova_api Aug 02 09:00:52.710028 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG oslo_db.sqlalchemy.engines [None req-35dce19a-8c98-4425-a5c9-60a678b4192c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103976) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:00:52.717549 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG dbcounter [-] [103976] Writer thread running {{(pid=103976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:00:52.717761 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG oslo_db.sqlalchemy.engines [None req-c8df3740-51e0-4338-98b6-ef14276d7910 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103975) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:00:52.724276 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG dbcounter [-] [103975] Writer thread running {{(pid=103975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:00:52.775393 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.context [None req-35dce19a-8c98-4425-a5c9-60a678b4192c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),894ae206-7d3e-4ce6-b69d-0b2312fd81e0(cell1) {{(pid=103976) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 09:00:52.779269 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG oslo_concurrency.lockutils [None req-35dce19a-8c98-4425-a5c9-60a678b4192c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:52.780901 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG oslo_concurrency.lockutils [None req-35dce19a-8c98-4425-a5c9-60a678b4192c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:52.781717 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG oslo_concurrency.lockutils [None req-35dce19a-8c98-4425-a5c9-60a678b4192c None None] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:52.782830 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.context [None req-c8df3740-51e0-4338-98b6-ef14276d7910 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),894ae206-7d3e-4ce6-b69d-0b2312fd81e0(cell1) {{(pid=103975) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 09:00:52.783830 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG oslo_concurrency.lockutils [None req-35dce19a-8c98-4425-a5c9-60a678b4192c None None] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:52.785772 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO dbcounter [None req-35dce19a-8c98-4425-a5c9-60a678b4192c None None] Registered counter for database nova_cell0 Aug 02 09:00:52.786831 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG oslo_concurrency.lockutils [None req-c8df3740-51e0-4338-98b6-ef14276d7910 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:52.789553 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG oslo_concurrency.lockutils [None req-c8df3740-51e0-4338-98b6-ef14276d7910 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:52.790572 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG oslo_concurrency.lockutils [None req-c8df3740-51e0-4338-98b6-ef14276d7910 None None] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:00:52.792116 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO dbcounter [None req-35dce19a-8c98-4425-a5c9-60a678b4192c None None] Registered counter for database nova_cell1 Aug 02 09:00:52.792385 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG oslo_concurrency.lockutils [None req-c8df3740-51e0-4338-98b6-ef14276d7910 None None] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103975) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:00:52.794383 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO dbcounter [None req-c8df3740-51e0-4338-98b6-ef14276d7910 None None] Registered counter for database nova_cell0 Aug 02 09:00:52.799346 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG oslo_db.sqlalchemy.engines [None req-35dce19a-8c98-4425-a5c9-60a678b4192c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103976) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:00:52.800119 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO dbcounter [None req-c8df3740-51e0-4338-98b6-ef14276d7910 None None] Registered counter for database nova_cell1 Aug 02 09:00:52.801637 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG oslo_db.sqlalchemy.engines [None req-35dce19a-8c98-4425-a5c9-60a678b4192c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103976) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:00:52.807280 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG dbcounter [-] [103976] Writer thread running {{(pid=103976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:00:52.809226 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG oslo_db.sqlalchemy.engines [None req-c8df3740-51e0-4338-98b6-ef14276d7910 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103975) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:00:52.810206 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG oslo_db.sqlalchemy.engines [None req-c8df3740-51e0-4338-98b6-ef14276d7910 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103975) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:00:52.810702 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG dbcounter [-] [103976] Writer thread running {{(pid=103976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:00:52.817393 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG dbcounter [-] [103975] Writer thread running {{(pid=103975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:00:52.819731 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG dbcounter [-] [103975] Writer thread running {{(pid=103975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:00:52.966070 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO dbcounter [None req-35dce19a-8c98-4425-a5c9-60a678b4192c None None] Registered counter for database nova_cell0 Aug 02 09:00:52.970807 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO dbcounter [None req-c8df3740-51e0-4338-98b6-ef14276d7910 None None] Registered counter for database nova_cell0 Aug 02 09:00:52.976466 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG oslo_db.sqlalchemy.engines [None req-35dce19a-8c98-4425-a5c9-60a678b4192c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103976) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:00:52.981104 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG dbcounter [-] [103976] Writer thread running {{(pid=103976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:00:52.982623 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG oslo_db.sqlalchemy.engines [None req-c8df3740-51e0-4338-98b6-ef14276d7910 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103975) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:00:52.987490 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG dbcounter [-] [103975] Writer thread running {{(pid=103975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:00:53.424345 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: WARNING keystonemiddleware.auth_token [None req-35dce19a-8c98-4425-a5c9-60a678b4192c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 09:00:53.432469 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: WARNING keystonemiddleware.auth_token [None req-35dce19a-8c98-4425-a5c9-60a678b4192c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 09:00:53.448551 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: WARNING keystonemiddleware.auth_token [None req-c8df3740-51e0-4338-98b6-ef14276d7910 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 09:00:53.455857 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: WARNING keystonemiddleware.auth_token [None req-c8df3740-51e0-4338-98b6-ef14276d7910 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 09:00:53.789045 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: WARNING keystonemiddleware.auth_token [None req-35dce19a-8c98-4425-a5c9-60a678b4192c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 09:00:53.795099 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: WARNING keystonemiddleware.auth_token [None req-35dce19a-8c98-4425-a5c9-60a678b4192c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 09:00:53.800394 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ce312179c0 pid: 103976 (default app) Aug 02 09:00:53.802510 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-35dce19a-8c98-4425-a5c9-60a678b4192c None None] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:00:53.804287 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-35dce19a-8c98-4425-a5c9-60a678b4192c None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002332 Aug 02 09:00:53.804712 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Tue Aug 2 09:00:53 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:00:53.818607 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: WARNING keystonemiddleware.auth_token [None req-c8df3740-51e0-4338-98b6-ef14276d7910 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 09:00:53.825577 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: WARNING keystonemiddleware.auth_token [None req-c8df3740-51e0-4338-98b6-ef14276d7910 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 09:00:53.831023 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ce312179c0 pid: 103975 (default app) Aug 02 09:02:23.662903 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-35dce19a-8c98-4425-a5c9-60a678b4192c None None] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:23.664647 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-35dce19a-8c98-4425-a5c9-60a678b4192c None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002382 Aug 02 09:02:23.665039 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 930 bytes} [Tue Aug 2 09:02:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:02:23.678424 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG dbcounter [-] [103975] Writing DB stats nova_api:SELECT=3 {{(pid=103975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:23.679704 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG dbcounter [-] [103975] Writing DB stats nova_cell0:SELECT=3 {{(pid=103975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:23.680525 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG dbcounter [-] [103975] Writing DB stats nova_cell1:SELECT=3 {{(pid=103975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:23.681643 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG dbcounter [-] [103975] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:24.933786 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-803fa397-0eea-4803-ab95-bea6a888f218 admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:24.968910 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-803fa397-0eea-4803-ab95-bea6a888f218 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.296470 Aug 02 09:02:24.969824 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Aug 2 09:02:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:28.029175 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-35dce19a-8c98-4425-a5c9-60a678b4192c None None] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:28.030179 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-35dce19a-8c98-4425-a5c9-60a678b4192c None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Aug 02 09:02:28.030580 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 930 bytes} [Tue Aug 2 09:02:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:02:28.622734 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-807f52ca-d5e7-4a03-a1c2-9a7f469935b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "vcpus": 1, "id": "c1", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:02:28.644562 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:02:28.644562 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: warnings.warn(msg) Aug 02 09:02:28.743980 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-807f52ca-d5e7-4a03-a1c2-9a7f469935b6 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.705252 Aug 02 09:02:28.745079 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Aug 2 09:02:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:02:28.761376 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG dbcounter [-] [103976] Writing DB stats nova_api:SELECT=3 {{(pid=103976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:28.762576 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG dbcounter [-] [103976] Writing DB stats nova_cell1:SELECT=3 {{(pid=103976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:28.764243 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG dbcounter [-] [103976] Writing DB stats nova_cell0:SELECT=3 {{(pid=103976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:28.765150 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG dbcounter [-] [103976] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:29.005395 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-1a210848-a048-41b3-8d8a-23b953080927 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:02:29.009880 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:02:29.009880 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: warnings.warn(msg) Aug 02 09:02:29.134534 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-1a210848-a048-41b3-8d8a-23b953080927 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.378739 Aug 02 09:02:29.135509 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Aug 2 09:02:28 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:31.693446 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-807f52ca-d5e7-4a03-a1c2-9a7f469935b6 admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:31.693446 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-807f52ca-d5e7-4a03-a1c2-9a7f469935b6 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001710 Aug 02 09:02:31.693446 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 930 bytes} [Tue Aug 2 09:02:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:02:32.825430 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-098c42fc-6177-444a-ac12-4a4dd345faef admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 5, "rxtx_factor": 1.0, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d1", "vcpus": 1, "name": "ds512M"}} {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:02:32.865700 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:02:32.865700 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: warnings.warn(msg) Aug 02 09:02:32.974106 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-098c42fc-6177-444a-ac12-4a4dd345faef admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.258143 Aug 02 09:02:32.975408 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Aug 2 09:02:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:02:32.992809 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-9322c5d7-3abb-40bf-a8ae-9762352d55a4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:02:32.995923 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:02:32.995923 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: warnings.warn(msg) Aug 02 09:02:33.120207 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-9322c5d7-3abb-40bf-a8ae-9762352d55a4 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131082 Aug 02 09:02:33.131218 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Aug 2 09:02:32 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:02:35.498465 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-098c42fc-6177-444a-ac12-4a4dd345faef admin admin] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:35.499578 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-098c42fc-6177-444a-ac12-4a4dd345faef admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Aug 02 09:02:35.500421 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 930 bytes} [Tue Aug 2 09:02:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:02:35.987320 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-6f88463a-3e6e-4396-bce7-415bef8503da admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "id": "d2", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10}} {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:02:36.097169 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-6f88463a-3e6e-4396-bce7-415bef8503da admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.589532 Aug 02 09:02:36.097663 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Aug 2 09:02:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:02:36.110271 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-a5f8f4ad-0287-4914-9a7f-71cdff7cb7fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:02:36.175628 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-a5f8f4ad-0287-4914-9a7f-71cdff7cb7fa admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069229 Aug 02 09:02:36.176198 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Aug 2 09:02:36 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:38.614542 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-6f88463a-3e6e-4396-bce7-415bef8503da admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:38.616745 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-6f88463a-3e6e-4396-bce7-415bef8503da admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002680 Aug 02 09:02:38.617399 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 930 bytes} [Tue Aug 2 09:02:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:02:39.110574 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-875efb1a-2e04-4396-b7d1-efcfbe5ad352 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "name": "ds2G", "id": "d3"}} {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:02:39.208637 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-875efb1a-2e04-4396-b7d1-efcfbe5ad352 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.584023 Aug 02 09:02:39.209871 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Aug 2 09:02:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:02:39.223888 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-85b3f286-53bb-4b3b-bdcb-b07da9bf46c8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:02:39.300981 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-85b3f286-53bb-4b3b-bdcb-b07da9bf46c8 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081908 Aug 02 09:02:39.301715 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Aug 2 09:02:39 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:41.679343 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-875efb1a-2e04-4396-b7d1-efcfbe5ad352 admin admin] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:41.683812 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-875efb1a-2e04-4396-b7d1-efcfbe5ad352 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002971 Aug 02 09:02:41.684611 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 930 bytes} [Tue Aug 2 09:02:41 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:02:42.163272 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-c52479e4-f007-4b6a-9696-67c597f6a80d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:02:42.275443 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-c52479e4-f007-4b6a-9696-67c597f6a80d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.581534 Aug 02 09:02:42.296480 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-cec42ee3-03c6-49cb-983b-7983f2c9fb43 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:02:42.298395 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Aug 2 09:02:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:02:42.379899 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-cec42ee3-03c6-49cb-983b-7983f2c9fb43 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094132 Aug 02 09:02:42.380533 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1335 bytes} [Tue Aug 2 09:02:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:44.771282 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-c52479e4-f007-4b6a-9696-67c597f6a80d admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:44.772643 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-c52479e4-f007-4b6a-9696-67c597f6a80d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002167 Aug 02 09:02:44.773126 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 930 bytes} [Tue Aug 2 09:02:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:02:45.363538 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-7159ad6a-80d2-46cb-8fc6-f05de772577b admin admin] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:45.390103 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-7159ad6a-80d2-46cb-8fc6-f05de772577b admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.610062 Aug 02 09:02:45.390656 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Aug 2 09:02:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:02:48.319318 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-c52479e4-f007-4b6a-9696-67c597f6a80d admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:48.320410 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-c52479e4-f007-4b6a-9696-67c597f6a80d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Aug 02 09:02:48.320809 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 930 bytes} [Tue Aug 2 09:02:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:02:48.818942 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-40c9e8cc-5297-4252-bfc6-e8cdc6d0334a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "name": "m1.tiny", "disk": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "id": "1", "vcpus": 1}} {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:02:48.913883 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-40c9e8cc-5297-4252-bfc6-e8cdc6d0334a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.586843 Aug 02 09:02:48.914792 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Aug 2 09:02:48 2022] POST /compute/v2.1/flavors => generated 402 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:02:48.926954 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-c6723eb6-9637-441e-b14d-a3e50d15ef44 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:02:49.032687 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-c6723eb6-9637-441e-b14d-a3e50d15ef44 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109715 Aug 02 09:02:49.033394 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Aug 2 09:02:48 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:51.383162 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-40c9e8cc-5297-4252-bfc6-e8cdc6d0334a admin admin] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:51.384214 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-40c9e8cc-5297-4252-bfc6-e8cdc6d0334a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Aug 02 09:02:51.384625 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 930 bytes} [Tue Aug 2 09:02:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:02:51.864905 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-16f09338-9518-474c-b6d2-b799bfc284da admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "2", "disk": 20, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 2048, "name": "m1.small"}} {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:02:51.958927 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-16f09338-9518-474c-b6d2-b799bfc284da admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.567686 Aug 02 09:02:51.959395 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Aug 2 09:02:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:02:51.972644 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-337cb76f-6def-4e5f-857c-796b7babaa05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:02:52.071489 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-337cb76f-6def-4e5f-857c-796b7babaa05 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103464 Aug 02 09:02:52.076234 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Aug 2 09:02:51 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:54.428736 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-16f09338-9518-474c-b6d2-b799bfc284da admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:54.429706 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-16f09338-9518-474c-b6d2-b799bfc284da admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002379 Aug 02 09:02:54.430161 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 930 bytes} [Tue Aug 2 09:02:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:02:54.958812 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-65af0a40-9c0e-44cc-bb41-418c08f430b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "id": "3", "swap": 0, "rxtx_factor": 1.0, "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096}} {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:02:55.068883 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-65af0a40-9c0e-44cc-bb41-418c08f430b9 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.632083 Aug 02 09:02:55.076317 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Aug 2 09:02:54 2022] POST /compute/v2.1/flavors => generated 406 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:02:55.082724 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-d70428d2-cd1a-4382-b357-9ec4fba5cd12 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:02:55.089818 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG dbcounter [-] [103975] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=103975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:02:55.158428 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-d70428d2-cd1a-4382-b357-9ec4fba5cd12 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079351 Aug 02 09:02:55.159362 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Aug 2 09:02:55 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:02:57.527320 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-65af0a40-9c0e-44cc-bb41-418c08f430b9 admin admin] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:02:57.528277 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-65af0a40-9c0e-44cc-bb41-418c08f430b9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Aug 02 09:02:57.528881 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 930 bytes} [Tue Aug 2 09:02:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:02:58.062161 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-c89543b1-5695-4222-b964-4d315a1de93e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "ram": 8192, "id": "4", "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:02:58.135218 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-c89543b1-5695-4222-b964-4d315a1de93e admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.599576 Aug 02 09:02:58.136248 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Aug 2 09:02:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:02:58.148936 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-f3812c70-0650-4a78-ba0a-c8511d061a2b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:02:58.248994 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-f3812c70-0650-4a78-ba0a-c8511d061a2b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103642 Aug 02 09:02:58.250649 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Aug 2 09:02:58 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:03:00.598365 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-c89543b1-5695-4222-b964-4d315a1de93e admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:00.599735 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-c89543b1-5695-4222-b964-4d315a1de93e admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003870 Aug 02 09:03:00.600684 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 930 bytes} [Tue Aug 2 09:03:00 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:01.167813 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-4c8b27cb-a0b6-4444-b560-3e7e65fd18bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "vcpus": 8, "rxtx_factor": 1.0, "id": "5", "ram": 16384, "disk": 160}} {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:01.256415 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-4c8b27cb-a0b6-4444-b560-3e7e65fd18bd admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.649094 Aug 02 09:03:01.256978 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1282 bytes} [Tue Aug 2 09:03:00 2022] POST /compute/v2.1/flavors => generated 408 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:03:01.270932 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-5c90f43d-d669-435c-80f5-729cc0c101bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:01.381751 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-5c90f43d-d669-435c-80f5-729cc0c101bf admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114508 Aug 02 09:03:01.383023 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1332 bytes} [Tue Aug 2 09:03:01 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:03:20.866907 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-4c8b27cb-a0b6-4444-b560-3e7e65fd18bd admin admin] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:20.868324 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-4c8b27cb-a0b6-4444-b560-3e7e65fd18bd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001991 Aug 02 09:03:20.869282 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 930 bytes} [Tue Aug 2 09:03:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:20.880894 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG dbcounter [-] [103975] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=103975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:21.309959 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-5f41c6e4-8362-4918-93ae-aab24b5920e7 admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:21.329807 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-5f41c6e4-8362-4918-93ae-aab24b5920e7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.453369 Aug 02 09:03:21.330360 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Aug 2 09:03:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:22.481717 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-4c8b27cb-a0b6-4444-b560-3e7e65fd18bd admin admin] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:22.482765 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-4c8b27cb-a0b6-4444-b560-3e7e65fd18bd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001537 Aug 02 09:03:22.483170 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 2 09:03:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:23.052764 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-b37ef4c8-0521-4821-80c0-db9735966eb6 admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:23.059508 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.wsgi [None req-b37ef4c8-0521-4821-80c0-db9735966eb6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 02 09:03:23.063779 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-b37ef4c8-0521-4821-80c0-db9735966eb6 admin admin] Request method failure captured: Aug 02 09:03:23.063779 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 02 09:03:23.063779 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: Accept: application/json Aug 02 09:03:23.063779 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: Accept-Encoding: gzip, deflate Aug 02 09:03:23.063779 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: Connection: keep-alive Aug 02 09:03:23.063779 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: Content-Length: 0 Aug 02 09:03:23.063779 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: Host: 10.222.0.20 Aug 02 09:03:23.063779 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: Openstack-Api-Version: compute 2.90 Aug 02 09:03:23.063779 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: Openstack-System-Scope: None Aug 02 09:03:23.063779 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: User-Agent: python-novaclient Aug 02 09:03:23.063779 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Auth-Token: gAAAAABi6OhasLHn4spBzrYVvz6QQ4jjibrZFStYDZnGK5PkX8uIfaSysfubVk3y_jSI0pIrqGY8n-ocAK-zza_f7Ei5pzyM2wqpl8pNwcx5unb8bpQhTWf1Emk9TYXukki4AyJKS-JhnzI5SBkpzPqRWkEt8-7vqc_FCNVOfk6IvPGgucr83jw Aug 02 09:03:23.063779 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Domain-Id: None Aug 02 09:03:23.063779 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Domain-Name: None Aug 02 09:03:23.063779 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Identity-Status: Confirmed Aug 02 09:03:23.063779 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Is-Admin-Project: True Aug 02 09:03:23.063779 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 09:03:23.063779 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Project-Domain-Id: default Aug 02 09:03:23.063779 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Project-Domain-Name: Default Aug 02 09:03:23.063779 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Project-Id: 4075c06a81874f9ca4b42e16828b98cd Aug 02 09:03:23.063779 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Project-Name: admin Aug 02 09:03:23.063779 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Role: member,reader,admin Aug 02 09:03:23.063779 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Roles: member,reader,admin Aug 02 09:03:23.071287 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4075c06a81874f9ca4b42e16828b98cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4075c06a81874f9ca4b42e16828b98cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4075c06a81874f9ca4b42e16828b98cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4075c06a81874f9ca4b42e16828b98cd"}]}] Aug 02 09:03:23.071287 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Tenant: admin Aug 02 09:03:23.071287 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Tenant-Id: 4075c06a81874f9ca4b42e16828b98cd Aug 02 09:03:23.071287 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Tenant-Name: admin Aug 02 09:03:23.071287 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-User: admin Aug 02 09:03:23.071287 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-User-Domain-Id: default Aug 02 09:03:23.071287 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-User-Domain-Name: Default Aug 02 09:03:23.071287 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-User-Id: c124f3deb85b49f5a9becf0360ac8d93 Aug 02 09:03:23.071287 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-User-Name: admin Aug 02 09:03:23.071287 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: method: > Aug 02 09:03:23.071287 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: exception: Flavor 42 could not be found. Aug 02 09:03:23.071287 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: action_args: {'id': '42'} Aug 02 09:03:23.071287 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:03:23.071287 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:23.072152 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 09:03:23.072152 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 09:03:23.072152 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 09:03:23.072152 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 09:03:23.072152 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 09:03:23.072152 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 09:03:23.072152 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 09:03:23.072152 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 09:03:23.072152 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 09:03:23.072152 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:03:23.072152 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 09:03:23.072152 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 09:03:23.072152 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 02 09:03:23.072152 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi Aug 02 09:03:23.072152 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:03:23.072152 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi Aug 02 09:03:23.072152 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:23.072152 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:03:23.072152 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:03:23.073371 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:03:23.073371 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:03:23.073371 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:03:23.073371 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:03:23.073371 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 09:03:23.073371 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:03:23.073371 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 02 09:03:23.073371 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi Aug 02 09:03:23.073371 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:03:23.073371 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi Aug 02 09:03:23.073371 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:23.073371 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:03:23.073371 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:03:23.073371 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:03:23.073371 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:03:23.073371 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 02 09:03:23.073371 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi Aug 02 09:03:23.073371 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-b37ef4c8-0521-4821-80c0-db9735966eb6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:03:23.074392 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-b37ef4c8-0521-4821-80c0-db9735966eb6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.433290 Aug 02 09:03:23.074392 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Aug 2 09:03:22 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 434 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:23.076178 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-87d13c88-af5c-424e-895d-93e790f8b28d admin admin] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:23.081408 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG dbcounter [-] [103976] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:03:23.101319 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-87d13c88-af5c-424e-895d-93e790f8b28d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028818 Aug 02 09:03:23.102048 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Aug 2 09:03:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:23.112460 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-f1dcd829-63ba-47e0-9369-afa86a6a2cbe admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:23.137909 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-f1dcd829-63ba-47e0-9369-afa86a6a2cbe admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029287 Aug 02 09:03:23.138463 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Aug 2 09:03:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:03:23.155544 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-fe3f0d59-53ed-411c-89f6-e167918d6c14 admin admin] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:23.163246 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.wsgi [None req-fe3f0d59-53ed-411c-89f6-e167918d6c14 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 02 09:03:23.166737 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-fe3f0d59-53ed-411c-89f6-e167918d6c14 admin admin] Request method failure captured: Aug 02 09:03:23.166737 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 02 09:03:23.166737 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: Accept: application/json Aug 02 09:03:23.166737 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: Accept-Encoding: gzip, deflate Aug 02 09:03:23.166737 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: Connection: keep-alive Aug 02 09:03:23.166737 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: Content-Length: 0 Aug 02 09:03:23.166737 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: Host: 10.222.0.20 Aug 02 09:03:23.166737 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: Openstack-Api-Version: compute 2.90 Aug 02 09:03:23.166737 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: Openstack-System-Scope: None Aug 02 09:03:23.166737 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: User-Agent: python-novaclient Aug 02 09:03:23.166737 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Auth-Token: gAAAAABi6OhasLHn4spBzrYVvz6QQ4jjibrZFStYDZnGK5PkX8uIfaSysfubVk3y_jSI0pIrqGY8n-ocAK-zza_f7Ei5pzyM2wqpl8pNwcx5unb8bpQhTWf1Emk9TYXukki4AyJKS-JhnzI5SBkpzPqRWkEt8-7vqc_FCNVOfk6IvPGgucr83jw Aug 02 09:03:23.166737 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Domain-Id: None Aug 02 09:03:23.166737 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Domain-Name: None Aug 02 09:03:23.166737 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Identity-Status: Confirmed Aug 02 09:03:23.166737 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Is-Admin-Project: True Aug 02 09:03:23.166737 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 09:03:23.166737 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Project-Domain-Id: default Aug 02 09:03:23.166737 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Project-Domain-Name: Default Aug 02 09:03:23.166737 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Project-Id: 4075c06a81874f9ca4b42e16828b98cd Aug 02 09:03:23.166737 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Project-Name: admin Aug 02 09:03:23.166737 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Role: member,reader,admin Aug 02 09:03:23.166737 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Roles: member,reader,admin Aug 02 09:03:23.169925 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4075c06a81874f9ca4b42e16828b98cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4075c06a81874f9ca4b42e16828b98cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4075c06a81874f9ca4b42e16828b98cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4075c06a81874f9ca4b42e16828b98cd"}]}] Aug 02 09:03:23.169925 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Tenant: admin Aug 02 09:03:23.169925 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Tenant-Id: 4075c06a81874f9ca4b42e16828b98cd Aug 02 09:03:23.169925 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Tenant-Name: admin Aug 02 09:03:23.169925 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-User: admin Aug 02 09:03:23.169925 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-User-Domain-Id: default Aug 02 09:03:23.169925 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-User-Domain-Name: Default Aug 02 09:03:23.169925 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-User-Id: c124f3deb85b49f5a9becf0360ac8d93 Aug 02 09:03:23.169925 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-User-Name: admin Aug 02 09:03:23.169925 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: method: > Aug 02 09:03:23.169925 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: exception: Flavor 42 could not be found. Aug 02 09:03:23.169925 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: action_args: {'id': '42'} Aug 02 09:03:23.169925 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:03:23.169925 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:23.171863 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 09:03:23.171863 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 09:03:23.171863 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 09:03:23.171863 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 09:03:23.171863 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 09:03:23.171863 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 09:03:23.171863 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 09:03:23.171863 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 09:03:23.171863 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 09:03:23.171863 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:03:23.171863 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 09:03:23.171863 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 09:03:23.171863 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 02 09:03:23.171863 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi Aug 02 09:03:23.171863 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:03:23.171863 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi Aug 02 09:03:23.171863 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:23.171863 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:03:23.171863 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:03:23.174408 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:03:23.174408 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:03:23.174408 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:03:23.174408 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:03:23.174408 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 09:03:23.174408 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:03:23.174408 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 02 09:03:23.174408 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi Aug 02 09:03:23.174408 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:03:23.174408 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi Aug 02 09:03:23.174408 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:23.174408 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:03:23.174408 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:03:23.174408 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:03:23.174408 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:03:23.174408 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 02 09:03:23.174408 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi Aug 02 09:03:23.174408 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-fe3f0d59-53ed-411c-89f6-e167918d6c14 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:03:23.177005 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-fe3f0d59-53ed-411c-89f6-e167918d6c14 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016590 Aug 02 09:03:23.177005 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Aug 2 09:03:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:24.217787 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-f1dcd829-63ba-47e0-9369-afa86a6a2cbe admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:24.218816 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-f1dcd829-63ba-47e0-9369-afa86a6a2cbe admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001694 Aug 02 09:03:24.219236 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 2 09:03:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:24.817010 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-32aa8bf1-7feb-4bdf-bfa3-bb8c0bf8d672 admin admin] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:24.822881 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.wsgi [None req-32aa8bf1-7feb-4bdf-bfa3-bb8c0bf8d672 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 02 09:03:24.835755 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-32aa8bf1-7feb-4bdf-bfa3-bb8c0bf8d672 admin admin] Request method failure captured: Aug 02 09:03:24.835755 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 02 09:03:24.835755 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: Accept: application/json Aug 02 09:03:24.835755 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: Accept-Encoding: gzip, deflate Aug 02 09:03:24.835755 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: Connection: keep-alive Aug 02 09:03:24.835755 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: Content-Length: 0 Aug 02 09:03:24.835755 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: Host: 10.222.0.20 Aug 02 09:03:24.835755 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: Openstack-Api-Version: compute 2.90 Aug 02 09:03:24.835755 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: Openstack-System-Scope: None Aug 02 09:03:24.835755 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: User-Agent: python-novaclient Aug 02 09:03:24.835755 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Auth-Token: gAAAAABi6OhcXfsLckK9sBHaCS-yd3ie_8mr5oyF4keZjy9nwgcr-qrtpyjSrbvce16CMyeWgtWxKlmQVHyPHb1i7HG8xrPA4wnZQSSzfrxyQlwUJkO_DIXYQImg19_cAX-7RUoTDGbS30QdNvYLblZ0yUIWDy_jqcCP9o7UOx1jkUjVKqMrEXI Aug 02 09:03:24.835755 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Domain-Id: None Aug 02 09:03:24.835755 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Domain-Name: None Aug 02 09:03:24.835755 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Identity-Status: Confirmed Aug 02 09:03:24.835755 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Is-Admin-Project: True Aug 02 09:03:24.835755 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 09:03:24.835755 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Project-Domain-Id: default Aug 02 09:03:24.835755 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Project-Domain-Name: Default Aug 02 09:03:24.835755 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Project-Id: 4075c06a81874f9ca4b42e16828b98cd Aug 02 09:03:24.835755 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Project-Name: admin Aug 02 09:03:24.835755 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Role: member,reader,admin Aug 02 09:03:24.835755 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Roles: member,reader,admin Aug 02 09:03:24.838271 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4075c06a81874f9ca4b42e16828b98cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4075c06a81874f9ca4b42e16828b98cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4075c06a81874f9ca4b42e16828b98cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4075c06a81874f9ca4b42e16828b98cd"}]}] Aug 02 09:03:24.838271 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Tenant: admin Aug 02 09:03:24.838271 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Tenant-Id: 4075c06a81874f9ca4b42e16828b98cd Aug 02 09:03:24.838271 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Tenant-Name: admin Aug 02 09:03:24.838271 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-User: admin Aug 02 09:03:24.838271 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-User-Domain-Id: default Aug 02 09:03:24.838271 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-User-Domain-Name: Default Aug 02 09:03:24.838271 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-User-Id: c124f3deb85b49f5a9becf0360ac8d93 Aug 02 09:03:24.838271 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-User-Name: admin Aug 02 09:03:24.838271 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: method: > Aug 02 09:03:24.838271 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: exception: Flavor 84 could not be found. Aug 02 09:03:24.838271 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: action_args: {'id': '84'} Aug 02 09:03:24.838271 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:03:24.838271 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:24.839185 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 09:03:24.839185 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 09:03:24.839185 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 09:03:24.839185 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 09:03:24.839185 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 09:03:24.839185 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 09:03:24.839185 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 09:03:24.839185 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 09:03:24.839185 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 09:03:24.839185 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:03:24.839185 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 09:03:24.839185 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 09:03:24.839185 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 02 09:03:24.839185 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi Aug 02 09:03:24.839185 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:03:24.839185 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi Aug 02 09:03:24.839185 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:24.839185 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:03:24.839185 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:03:24.840689 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:03:24.840689 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:03:24.840689 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:03:24.840689 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:03:24.840689 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 09:03:24.840689 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:03:24.840689 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 02 09:03:24.840689 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi Aug 02 09:03:24.840689 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:03:24.840689 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi Aug 02 09:03:24.840689 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:24.840689 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:03:24.840689 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:03:24.840689 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:03:24.840689 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:03:24.840689 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 02 09:03:24.840689 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi Aug 02 09:03:24.840689 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-32aa8bf1-7feb-4bdf-bfa3-bb8c0bf8d672 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:03:24.842588 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-32aa8bf1-7feb-4bdf-bfa3-bb8c0bf8d672 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.447290 Aug 02 09:03:24.842588 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Aug 2 09:03:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 449 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:24.842770 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-81544cbd-417b-459d-8285-840fab9dc91d admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:24.854427 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-81544cbd-417b-459d-8285-840fab9dc91d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020882 Aug 02 09:03:24.855007 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Aug 2 09:03:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:24.867778 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-25565788-b61d-469f-b123-36bda53bf05a admin admin] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:24.883515 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-25565788-b61d-469f-b123-36bda53bf05a admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019412 Aug 02 09:03:24.884063 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Aug 2 09:03:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:24.895371 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-e76719ef-b157-4bf8-bed2-120f7405fe2e admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:24.901117 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.wsgi [None req-e76719ef-b157-4bf8-bed2-120f7405fe2e admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 02 09:03:24.902640 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-e76719ef-b157-4bf8-bed2-120f7405fe2e admin admin] Request method failure captured: Aug 02 09:03:24.902640 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 02 09:03:24.902640 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: Accept: application/json Aug 02 09:03:24.902640 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: Accept-Encoding: gzip, deflate Aug 02 09:03:24.902640 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: Connection: keep-alive Aug 02 09:03:24.902640 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: Content-Length: 0 Aug 02 09:03:24.902640 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: Host: 10.222.0.20 Aug 02 09:03:24.902640 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: Openstack-Api-Version: compute 2.90 Aug 02 09:03:24.902640 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: Openstack-System-Scope: None Aug 02 09:03:24.902640 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: User-Agent: python-novaclient Aug 02 09:03:24.902640 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Auth-Token: gAAAAABi6OhcXfsLckK9sBHaCS-yd3ie_8mr5oyF4keZjy9nwgcr-qrtpyjSrbvce16CMyeWgtWxKlmQVHyPHb1i7HG8xrPA4wnZQSSzfrxyQlwUJkO_DIXYQImg19_cAX-7RUoTDGbS30QdNvYLblZ0yUIWDy_jqcCP9o7UOx1jkUjVKqMrEXI Aug 02 09:03:24.902640 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Domain-Id: None Aug 02 09:03:24.902640 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Domain-Name: None Aug 02 09:03:24.902640 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Identity-Status: Confirmed Aug 02 09:03:24.902640 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Is-Admin-Project: True Aug 02 09:03:24.902640 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 09:03:24.902640 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Project-Domain-Id: default Aug 02 09:03:24.902640 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Project-Domain-Name: Default Aug 02 09:03:24.902640 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Project-Id: 4075c06a81874f9ca4b42e16828b98cd Aug 02 09:03:24.902640 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Project-Name: admin Aug 02 09:03:24.902640 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Role: member,reader,admin Aug 02 09:03:24.902640 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Roles: member,reader,admin Aug 02 09:03:24.906410 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4075c06a81874f9ca4b42e16828b98cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4075c06a81874f9ca4b42e16828b98cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4075c06a81874f9ca4b42e16828b98cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4075c06a81874f9ca4b42e16828b98cd"}]}] Aug 02 09:03:24.906410 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Tenant: admin Aug 02 09:03:24.906410 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Tenant-Id: 4075c06a81874f9ca4b42e16828b98cd Aug 02 09:03:24.906410 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Tenant-Name: admin Aug 02 09:03:24.906410 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-User: admin Aug 02 09:03:24.906410 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-User-Domain-Id: default Aug 02 09:03:24.906410 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-User-Domain-Name: Default Aug 02 09:03:24.906410 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-User-Id: c124f3deb85b49f5a9becf0360ac8d93 Aug 02 09:03:24.906410 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-User-Name: admin Aug 02 09:03:24.906410 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: method: > Aug 02 09:03:24.906410 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: exception: Flavor 84 could not be found. Aug 02 09:03:24.906410 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: action_args: {'id': '84'} Aug 02 09:03:24.906410 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:03:24.906410 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:24.907460 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 09:03:24.907460 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 09:03:24.907460 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 09:03:24.907460 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 09:03:24.907460 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 09:03:24.907460 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 09:03:24.907460 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 09:03:24.907460 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 09:03:24.907460 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 09:03:24.907460 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:03:24.907460 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 09:03:24.907460 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 09:03:24.907460 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 02 09:03:24.907460 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi Aug 02 09:03:24.907460 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:03:24.907460 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi Aug 02 09:03:24.907460 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:24.907460 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:03:24.907460 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:03:24.908925 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:03:24.908925 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:03:24.908925 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:03:24.908925 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:03:24.908925 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 09:03:24.908925 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:03:24.908925 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 02 09:03:24.908925 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi Aug 02 09:03:24.908925 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:03:24.908925 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi Aug 02 09:03:24.908925 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:24.908925 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:03:24.908925 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:03:24.908925 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:03:24.908925 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:03:24.908925 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 02 09:03:24.908925 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi Aug 02 09:03:24.908925 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-e76719ef-b157-4bf8-bed2-120f7405fe2e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:03:24.910116 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-e76719ef-b157-4bf8-bed2-120f7405fe2e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013345 Aug 02 09:03:24.910116 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Aug 2 09:03:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:25.921910 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-25565788-b61d-469f-b123-36bda53bf05a admin admin] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:25.922921 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-25565788-b61d-469f-b123-36bda53bf05a admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 02 09:03:25.923391 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 2 09:03:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:26.512957 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-f0b9bf2b-c0c4-4d79-8067-ee296612dbe2 admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:26.521579 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.wsgi [None req-f0b9bf2b-c0c4-4d79-8067-ee296612dbe2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 02 09:03:26.523160 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-f0b9bf2b-c0c4-4d79-8067-ee296612dbe2 admin admin] Request method failure captured: Aug 02 09:03:26.523160 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 02 09:03:26.523160 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: Accept: application/json Aug 02 09:03:26.523160 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: Accept-Encoding: gzip, deflate Aug 02 09:03:26.523160 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: Connection: keep-alive Aug 02 09:03:26.523160 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: Content-Length: 0 Aug 02 09:03:26.523160 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: Host: 10.222.0.20 Aug 02 09:03:26.523160 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: Openstack-Api-Version: compute 2.90 Aug 02 09:03:26.523160 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: Openstack-System-Scope: None Aug 02 09:03:26.523160 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: User-Agent: python-novaclient Aug 02 09:03:26.523160 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Auth-Token: gAAAAABi6OhdlgJGawij6UMqcDiDCsSpE2h12F9WF3lC90Uq5s6qwPtp6rtKT4Y-2QFxRu62UVRwXYq7xx68srR7Cwj0MtTbwk7VM5Wyey7Cxd1HoyAvii7EKyoZklM7MlOyBMaUhDcgjhQdznHmZ5rTcsz9cS9oJyJxnm0w5EzWWLgp--bAZ7U Aug 02 09:03:26.523160 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Domain-Id: None Aug 02 09:03:26.523160 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Domain-Name: None Aug 02 09:03:26.523160 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Identity-Status: Confirmed Aug 02 09:03:26.523160 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Is-Admin-Project: True Aug 02 09:03:26.523160 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 09:03:26.523160 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Project-Domain-Id: default Aug 02 09:03:26.523160 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Project-Domain-Name: Default Aug 02 09:03:26.523160 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Project-Id: 4075c06a81874f9ca4b42e16828b98cd Aug 02 09:03:26.523160 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Project-Name: admin Aug 02 09:03:26.523160 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Role: member,reader,admin Aug 02 09:03:26.523160 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Roles: member,reader,admin Aug 02 09:03:26.524740 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4075c06a81874f9ca4b42e16828b98cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4075c06a81874f9ca4b42e16828b98cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4075c06a81874f9ca4b42e16828b98cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4075c06a81874f9ca4b42e16828b98cd"}]}] Aug 02 09:03:26.524740 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Tenant: admin Aug 02 09:03:26.524740 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Tenant-Id: 4075c06a81874f9ca4b42e16828b98cd Aug 02 09:03:26.524740 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-Tenant-Name: admin Aug 02 09:03:26.524740 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-User: admin Aug 02 09:03:26.524740 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-User-Domain-Id: default Aug 02 09:03:26.524740 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-User-Domain-Name: Default Aug 02 09:03:26.524740 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-User-Id: c124f3deb85b49f5a9becf0360ac8d93 Aug 02 09:03:26.524740 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: X-User-Name: admin Aug 02 09:03:26.524740 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: method: > Aug 02 09:03:26.524740 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: exception: Flavor 451 could not be found. Aug 02 09:03:26.524740 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: action_args: {'id': '451'} Aug 02 09:03:26.524740 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:03:26.524740 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:26.525569 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 09:03:26.525569 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 09:03:26.525569 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 09:03:26.525569 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 09:03:26.525569 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 09:03:26.525569 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 09:03:26.525569 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 09:03:26.525569 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 09:03:26.525569 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 09:03:26.525569 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:03:26.525569 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 09:03:26.525569 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 09:03:26.525569 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 02 09:03:26.525569 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi Aug 02 09:03:26.525569 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:03:26.525569 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi Aug 02 09:03:26.525569 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:26.525569 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:03:26.525569 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:03:26.526624 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:03:26.526624 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:03:26.526624 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:03:26.526624 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:03:26.526624 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 09:03:26.526624 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:03:26.526624 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 02 09:03:26.526624 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi Aug 02 09:03:26.526624 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:03:26.526624 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi Aug 02 09:03:26.526624 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:26.526624 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:03:26.526624 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:03:26.526624 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:03:26.526624 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:03:26.526624 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 02 09:03:26.526624 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: ERROR nova.api.openstack.wsgi Aug 02 09:03:26.526624 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-f0b9bf2b-c0c4-4d79-8067-ee296612dbe2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103975) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:03:26.528279 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-f0b9bf2b-c0c4-4d79-8067-ee296612dbe2 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.459794 Aug 02 09:03:26.528279 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Aug 2 09:03:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 461 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:26.536038 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-baff5c9a-3c55-4578-835c-7a84edda4a69 admin admin] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:26.551704 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-baff5c9a-3c55-4578-835c-7a84edda4a69 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019522 Aug 02 09:03:26.552351 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Aug 2 09:03:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:26.564064 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-4ffff5fc-1798-42c9-9eb3-ea43dfd149ef admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:26.580828 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-4ffff5fc-1798-42c9-9eb3-ea43dfd149ef admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020858 Aug 02 09:03:26.581371 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Aug 2 09:03:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:03:26.591657 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-8298222b-f677-428b-878b-354f26ba7c20 admin admin] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:26.598723 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.wsgi [None req-8298222b-f677-428b-878b-354f26ba7c20 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 02 09:03:26.600306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-8298222b-f677-428b-878b-354f26ba7c20 admin admin] Request method failure captured: Aug 02 09:03:26.600306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 02 09:03:26.600306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: Accept: application/json Aug 02 09:03:26.600306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: Accept-Encoding: gzip, deflate Aug 02 09:03:26.600306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: Connection: keep-alive Aug 02 09:03:26.600306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: Content-Length: 0 Aug 02 09:03:26.600306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: Host: 10.222.0.20 Aug 02 09:03:26.600306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: Openstack-Api-Version: compute 2.90 Aug 02 09:03:26.600306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: Openstack-System-Scope: None Aug 02 09:03:26.600306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: User-Agent: python-novaclient Aug 02 09:03:26.600306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Auth-Token: gAAAAABi6OhdlgJGawij6UMqcDiDCsSpE2h12F9WF3lC90Uq5s6qwPtp6rtKT4Y-2QFxRu62UVRwXYq7xx68srR7Cwj0MtTbwk7VM5Wyey7Cxd1HoyAvii7EKyoZklM7MlOyBMaUhDcgjhQdznHmZ5rTcsz9cS9oJyJxnm0w5EzWWLgp--bAZ7U Aug 02 09:03:26.600306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Domain-Id: None Aug 02 09:03:26.600306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Domain-Name: None Aug 02 09:03:26.600306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Identity-Status: Confirmed Aug 02 09:03:26.600306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Is-Admin-Project: True Aug 02 09:03:26.600306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Openstack-Nova-Api-Version: 2.90 Aug 02 09:03:26.600306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Project-Domain-Id: default Aug 02 09:03:26.600306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Project-Domain-Name: Default Aug 02 09:03:26.600306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Project-Id: 4075c06a81874f9ca4b42e16828b98cd Aug 02 09:03:26.600306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Project-Name: admin Aug 02 09:03:26.600306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Role: member,reader,admin Aug 02 09:03:26.600306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Roles: member,reader,admin Aug 02 09:03:26.601914 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4075c06a81874f9ca4b42e16828b98cd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/4075c06a81874f9ca4b42e16828b98cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/4075c06a81874f9ca4b42e16828b98cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_4075c06a81874f9ca4b42e16828b98cd"}]}] Aug 02 09:03:26.601914 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Tenant: admin Aug 02 09:03:26.601914 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Tenant-Id: 4075c06a81874f9ca4b42e16828b98cd Aug 02 09:03:26.601914 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-Tenant-Name: admin Aug 02 09:03:26.601914 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-User: admin Aug 02 09:03:26.601914 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-User-Domain-Id: default Aug 02 09:03:26.601914 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-User-Domain-Name: Default Aug 02 09:03:26.601914 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-User-Id: c124f3deb85b49f5a9becf0360ac8d93 Aug 02 09:03:26.601914 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: X-User-Name: admin Aug 02 09:03:26.601914 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: method: > Aug 02 09:03:26.601914 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: exception: Flavor 451 could not be found. Aug 02 09:03:26.601914 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: action_args: {'id': '451'} Aug 02 09:03:26.601914 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:03:26.601914 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:26.602878 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 02 09:03:26.602878 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 02 09:03:26.602878 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 02 09:03:26.602878 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 02 09:03:26.602878 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 09:03:26.602878 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 09:03:26.602878 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 02 09:03:26.602878 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 02 09:03:26.602878 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 02 09:03:26.602878 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:03:26.602878 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 02 09:03:26.602878 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 02 09:03:26.602878 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 02 09:03:26.602878 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi Aug 02 09:03:26.602878 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:03:26.602878 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi Aug 02 09:03:26.602878 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:26.602878 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:03:26.602878 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:03:26.604383 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:03:26.604383 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:03:26.604383 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:03:26.604383 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:03:26.604383 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 02 09:03:26.604383 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:03:26.604383 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 02 09:03:26.604383 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi Aug 02 09:03:26.604383 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:03:26.604383 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi Aug 02 09:03:26.604383 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:03:26.604383 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:03:26.604383 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:03:26.604383 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:03:26.604383 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:03:26.604383 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 02 09:03:26.604383 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: ERROR nova.api.openstack.wsgi Aug 02 09:03:26.604383 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-8298222b-f677-428b-878b-354f26ba7c20 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103976) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:03:26.605712 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-8298222b-f677-428b-878b-354f26ba7c20 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013934 Aug 02 09:03:26.605712 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Aug 2 09:03:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 02 09:03:27.606942 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-4ffff5fc-1798-42c9-9eb3-ea43dfd149ef admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:27.608049 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-4ffff5fc-1798-42c9-9eb3-ea43dfd149ef admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Aug 02 09:03:27.608488 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 2 09:03:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:28.174163 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-5ffdf7dd-e76c-45c7-aaec-7374a19b7423 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:28.250001 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-5ffdf7dd-e76c-45c7-aaec-7374a19b7423 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.500445 Aug 02 09:03:28.250668 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Aug 2 09:03:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:03:29.276975 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-4ffff5fc-1798-42c9-9eb3-ea43dfd149ef admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:29.277979 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-4ffff5fc-1798-42c9-9eb3-ea43dfd149ef admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Aug 02 09:03:29.278376 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 2 09:03:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:03:29.853807 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-15a70465-f64d-42d0-a387-302bcce9e925 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:29.956569 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-15a70465-f64d-42d0-a387-302bcce9e925 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.535227 Aug 02 09:03:29.957129 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Aug 2 09:03:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:03:30.965094 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-4ffff5fc-1798-42c9-9eb3-ea43dfd149ef admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:30.966093 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-4ffff5fc-1798-42c9-9eb3-ea43dfd149ef admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Aug 02 09:03:30.966547 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 2 09:03:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:31.553468 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-614bee61-d4b2-40f9-b856-0ad298a0440a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:31.684959 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-614bee61-d4b2-40f9-b856-0ad298a0440a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.567424 Aug 02 09:03:31.686176 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Aug 2 09:03:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:03:32.936719 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-4ffff5fc-1798-42c9-9eb3-ea43dfd149ef admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:32.938135 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-4ffff5fc-1798-42c9-9eb3-ea43dfd149ef admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002054 Aug 02 09:03:32.938751 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 2 09:03:32 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:33.584673 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-9c753a7a-76a1-423d-836e-540c6bef3e3c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:03:33.666250 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-9c753a7a-76a1-423d-836e-540c6bef3e3c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.578248 Aug 02 09:03:33.666803 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Aug 2 09:03:33 2022] POST /compute/v2.1/flavors => generated 409 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:03:34.683879 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-4ffff5fc-1798-42c9-9eb3-ea43dfd149ef admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:34.684927 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-4ffff5fc-1798-42c9-9eb3-ea43dfd149ef admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Aug 02 09:03:34.685430 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 2 09:03:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:03:35.235061 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-975bf7da-15a4-4e40-9ecb-3a0340381f80 admin admin] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:03:35.256351 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-975bf7da-15a4-4e40-9ecb-3a0340381f80 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.428717 Aug 02 09:03:35.256903 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Tue Aug 2 09:03:34 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:04:29.424476 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-4ffff5fc-1798-42c9-9eb3-ea43dfd149ef admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:29.425489 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-4ffff5fc-1798-42c9-9eb3-ea43dfd149ef admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 02 09:04:29.425878 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 930 bytes} [Tue Aug 2 09:04:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:04:29.437946 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG dbcounter [-] [103976] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:29.845442 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-718592f5-13db-4cf6-bb79-ed356372e1c9 admin admin] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:29.865464 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-718592f5-13db-4cf6-bb79-ed356372e1c9 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.433189 Aug 02 09:04:29.866020 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1291 bytes} [Tue Aug 2 09:04:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:04:29.889713 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG dbcounter [-] [103975] Writing DB stats nova_api:SELECT=14 {{(pid=103975) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:04:29.893507 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-daefb023-c8fd-4ec7-a398-8254c143be36 admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:29.902056 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-daefb023-c8fd-4ec7-a398-8254c143be36 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013608 Aug 02 09:04:29.909029 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1282 bytes} [Tue Aug 2 09:04:29 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:04:29.914789 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-6c6399e0-4ced-4fdd-a308-35ef4675ace5 admin admin] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:29.923300 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-6c6399e0-4ced-4fdd-a308-35ef4675ace5 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012180 Aug 02 09:04:29.923841 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1285 bytes} [Tue Aug 2 09:04:29 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:04:29.936234 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-ee564371-e60a-40be-97d8-69c8dd20f891 admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:29.944771 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-ee564371-e60a-40be-97d8-69c8dd20f891 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012824 Aug 02 09:04:29.945327 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1285 bytes} [Tue Aug 2 09:04:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:04:29.958002 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-e9435fa9-d357-47b5-9d7c-4af9983c3a5e admin admin] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:04:29.966306 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-e9435fa9-d357-47b5-9d7c-4af9983c3a5e admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011896 Aug 02 09:04:29.966858 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1282 bytes} [Tue Aug 2 09:04:29 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:08:06.813607 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-ee564371-e60a-40be-97d8-69c8dd20f891 admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:06.814756 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-ee564371-e60a-40be-97d8-69c8dd20f891 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001796 Aug 02 09:08:06.815156 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 2 09:08:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:08:06.963526 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG dbcounter [-] [103976] Writing DB stats nova_api:SELECT=6 {{(pid=103976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:07.110677 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-e6469307-b54d-4d72-8735-da0b919de592 admin admin] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:07.113110 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:08:07.113110 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: warnings.warn(msg) Aug 02 09:08:07.114361 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG oslo_concurrency.lockutils [None req-e6469307-b54d-4d72-8735-da0b919de592 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:07.114795 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG oslo_concurrency.lockutils [None req-e6469307-b54d-4d72-8735-da0b919de592 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:07.115576 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG oslo_concurrency.lockutils [None req-e6469307-b54d-4d72-8735-da0b919de592 admin admin] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:07.115994 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG oslo_concurrency.lockutils [None req-e6469307-b54d-4d72-8735-da0b919de592 admin admin] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:07.152050 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-e6469307-b54d-4d72-8735-da0b919de592 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.194717 Aug 02 09:08:07.152653 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Aug 2 09:08:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:08:08.044123 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-ee564371-e60a-40be-97d8-69c8dd20f891 admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:08.045158 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-ee564371-e60a-40be-97d8-69c8dd20f891 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Aug 02 09:08:08.045701 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 2 09:08:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:08:08.250170 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-83c00e95-cdea-4dd3-b67b-6b5ad25281df admin admin] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:08.252626 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:08:08.252626 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: warnings.warn(msg) Aug 02 09:08:08.253797 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG oslo_concurrency.lockutils [None req-83c00e95-cdea-4dd3-b67b-6b5ad25281df admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:08.254224 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG oslo_concurrency.lockutils [None req-83c00e95-cdea-4dd3-b67b-6b5ad25281df admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:08.254992 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG oslo_concurrency.lockutils [None req-83c00e95-cdea-4dd3-b67b-6b5ad25281df admin admin] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:08.255410 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG oslo_concurrency.lockutils [None req-83c00e95-cdea-4dd3-b67b-6b5ad25281df admin admin] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:08.276228 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-83c00e95-cdea-4dd3-b67b-6b5ad25281df admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077276 Aug 02 09:08:08.276742 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Aug 2 09:08:08 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:08:19.510674 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-ee564371-e60a-40be-97d8-69c8dd20f891 admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:19.511675 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-ee564371-e60a-40be-97d8-69c8dd20f891 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 02 09:08:19.512069 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 2 09:08:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:08:19.663965 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG dbcounter [-] [103976] Writing DB stats nova_cell0:SELECT=4 {{(pid=103976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:19.664928 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG dbcounter [-] [103976] Writing DB stats nova_cell1:SELECT=4 {{(pid=103976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:19.665553 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG dbcounter [-] [103976] Writing DB stats nova_api:SELECT=8 {{(pid=103976) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:08:19.715857 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-506ba062-c178-42e0-b1c5-ef1a7f74ef5f admin admin] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:19.720816 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:08:19.720816 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: warnings.warn(msg) Aug 02 09:08:19.720816 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG oslo_concurrency.lockutils [None req-506ba062-c178-42e0-b1c5-ef1a7f74ef5f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:19.720816 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG oslo_concurrency.lockutils [None req-506ba062-c178-42e0-b1c5-ef1a7f74ef5f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:19.721433 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG oslo_concurrency.lockutils [None req-506ba062-c178-42e0-b1c5-ef1a7f74ef5f admin admin] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:19.721585 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG oslo_concurrency.lockutils [None req-506ba062-c178-42e0-b1c5-ef1a7f74ef5f admin admin] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:19.750035 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-506ba062-c178-42e0-b1c5-ef1a7f74ef5f admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.089117 Aug 02 09:08:19.750035 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Aug 2 09:08:19 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:08:20.609863 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: DEBUG nova.api.openstack.wsgi [None req-ee564371-e60a-40be-97d8-69c8dd20f891 admin admin] Calling method '>' {{(pid=103975) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:20.610903 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: INFO nova.api.openstack.requestlog [None req-ee564371-e60a-40be-97d8-69c8dd20f891 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Aug 02 09:08:20.611303 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: [pid: 103975|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 2 09:08:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:08:20.809725 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG nova.api.openstack.wsgi [None req-527a564d-2be2-450e-a9ee-51b273d07fd2 admin admin] Calling method '>' {{(pid=103976) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:08:20.812179 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 09:08:20.812179 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: warnings.warn(msg) Aug 02 09:08:20.813407 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG oslo_concurrency.lockutils [None req-527a564d-2be2-450e-a9ee-51b273d07fd2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:20.813848 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG oslo_concurrency.lockutils [None req-527a564d-2be2-450e-a9ee-51b273d07fd2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:20.814643 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG oslo_concurrency.lockutils [None req-527a564d-2be2-450e-a9ee-51b273d07fd2 admin admin] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:08:20.815070 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: DEBUG oslo_concurrency.lockutils [None req-527a564d-2be2-450e-a9ee-51b273d07fd2 admin admin] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103976) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:08:20.837525 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: INFO nova.api.openstack.requestlog [None req-527a564d-2be2-450e-a9ee-51b273d07fd2 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.085372 Aug 02 09:08:20.838008 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: [pid: 103976|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Aug 2 09:08:20 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:09:18.219180 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: Tue Aug 2 09:09:18 2022 - graceful shutdown triggered... Aug 02 09:09:18.219422 dv-cinder-845990-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 02 09:09:18.220218 dv-cinder-845990-6-iscsi devstack@n-api.service[103975]: Gracefully killing worker 1 (pid: 103975)... Aug 02 09:09:18.221269 dv-cinder-845990-6-iscsi devstack@n-api.service[103976]: Gracefully killing worker 2 (pid: 103976)... Aug 02 09:09:19.220349 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: worker 1 buried after 1 seconds Aug 02 09:09:19.220349 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: worker 2 buried after 1 seconds Aug 02 09:09:19.220349 dv-cinder-845990-6-iscsi devstack@n-api.service[103974]: goodbye to uWSGI. Aug 02 09:09:19.221955 dv-cinder-845990-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 02 09:09:19.222526 dv-cinder-845990-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 02 09:09:19.225374 dv-cinder-845990-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 02 09:09:19.239110 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 02 09:09:19.242609 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 09:09:19 2022] *** Aug 02 09:09:19.242609 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 09:09:19.242609 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 09:09:19.242609 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: nodename: dv-cinder-845990-6-iscsi Aug 02 09:09:19.242609 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: machine: x86_64 Aug 02 09:09:19.242609 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: clock source: unix Aug 02 09:09:19.242609 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: pcre jit disabled Aug 02 09:09:19.242609 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: detected number of CPU cores: 4 Aug 02 09:09:19.242609 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: current working directory: / Aug 02 09:09:19.242609 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: detected binary path: /usr/bin/uwsgi-core Aug 02 09:09:19.242609 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: your processes number limit is 47680 Aug 02 09:09:19.242609 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: your memory page size is 4096 bytes Aug 02 09:09:19.243760 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: detected max file descriptor number: 2048 Aug 02 09:09:19.243760 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: lock engine: pthread robust mutexes Aug 02 09:09:19.243760 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: thunder lock: enabled Aug 02 09:09:19.243760 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 02 09:09:19.243760 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 09:09:19.285130 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: Python main interpreter initialized at 0x56167efe49c0 Aug 02 09:09:19.285130 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: python threads support enabled Aug 02 09:09:19.285130 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: your server socket listen backlog is limited to 100 connections Aug 02 09:09:19.285130 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: your mercy for graceful operations on workers is 90 seconds Aug 02 09:09:19.285554 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 09:09:19.285554 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: *** Operational MODE: preforking *** Aug 02 09:09:19.285867 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: *** uWSGI is running in multiple interpreter mode *** Aug 02 09:09:19.285867 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: spawned uWSGI master process (pid: 118510) Aug 02 09:09:19.286070 dv-cinder-845990-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 02 09:09:19.289002 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: spawned uWSGI worker 1 (pid: 118525, cores: 1) Aug 02 09:09:19.289002 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: spawned uWSGI worker 2 (pid: 118526, cores: 1) Aug 02 09:09:19.289002 dv-cinder-845990-6-iscsi devstack@n-api.service[118510]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 09:09:19.971182 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 09:09:19.978580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 02 09:09:21.163372 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:09:21.163372 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: from cryptography.utils import int_from_bytes Aug 02 09:09:21.164538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:09:21.164538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: from cryptography.utils import int_from_bytes Aug 02 09:09:21.164962 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:09:21.164962 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: from cryptography.utils import int_from_bytes Aug 02 09:09:21.165093 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 09:09:21.165093 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: from cryptography.utils import int_from_bytes Aug 02 09:09:23.634665 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 09:09:23.635377 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 09:09:23.635482 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 09:09:23.635839 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 09:09:23.636099 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 09:09:23.636521 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.636861 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.637191 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.637513 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.637853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.638170 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.638495 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.638829 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.639164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.639431 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.639753 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.640081 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845990-6-iscsi {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.640440 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.640918 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.641239 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.641674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.641873 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.642207 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.642540 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.643047 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.643492 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.643809 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.644650 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.644650 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.644837 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.645105 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.645432 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.647109 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.647109 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.647109 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.647109 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845990-6-iscsi {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.647109 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.647486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.647718 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.649230 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.649565 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.649891 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.650225 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.650556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.650868 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.651216 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.651767 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 09:09:23.652326 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.652429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 09:09:23.652514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.652514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.652656 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 09:09:23.652733 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.652959 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 09:09:23.653179 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.653280 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 09:09:23.653355 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.653595 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.653703 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.653928 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.654035 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.654254 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.654371 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.654516 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.654622 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.654822 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.654975 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.655169 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.655264 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.655478 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.655585 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.655805 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.655914 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.656066 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.656194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.656360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.656489 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.656730 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.656981 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.657223 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.657462 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-845990-6-iscsi {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.657689 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.657939 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.658188 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.658369 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.658515 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.658688 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.658865 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.659028 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.659173 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.659173 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.659492 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.659492 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.659776 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.659936 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.660087 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.660087 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.660393 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.660556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.660712 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.660864 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.661026 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.661169 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.661311 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.661538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.661713 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.661866 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.662019 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.662172 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.662314 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.662462 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.662615 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.662767 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.662925 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.663088 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.663421 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.663600 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.663760 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.664004 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.664271 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-845990-6-iscsi {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.664271 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.664743 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.664896 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.665039 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.665039 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.665321 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.665482 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.665742 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.665904 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.666048 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.666199 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.666342 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.666493 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.666645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.666788 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.666936 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.667079 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.667221 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.667373 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.667534 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.667684 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.667837 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.667988 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.668137 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.668375 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.668529 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.668687 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.668836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.668979 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.669120 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.669275 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.669426 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.669426 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.669717 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.669867 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.670011 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.670166 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.670310 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.670452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.670600 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.670751 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.671234 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.671390 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.671588 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.671818 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.671999 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.672144 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.672358 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.672509 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.672509 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.672799 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.672950 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.673107 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.673251 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.673432 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.673713 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.673881 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.674033 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.674186 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.674345 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.674499 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.674651 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.674800 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.674949 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.675091 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.675232 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.675381 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.675535 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.675685 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.675968 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.676125 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.676357 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.676502 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.676659 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.676810 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.676960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.677101 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.677313 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.677535 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.677768 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.677997 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.678173 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.678324 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.678466 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.678617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.678771 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.678921 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.679131 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.679322 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.679561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.679810 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.680043 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.680347 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.680521 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.680678 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.680830 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.680830 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.681124 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.681267 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.681415 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.681558 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.681699 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.681857 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.682005 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.682147 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.682301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.682449 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.682689 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.682844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.682995 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.683138 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.683279 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.683421 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.683576 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.683746 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.684026 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.684195 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.684344 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.684499 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.684657 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.684814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.684956 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.685110 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.685110 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.685387 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.685549 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.685702 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.685852 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.686112 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.686263 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.686415 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.686558 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.686712 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.686864 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.687007 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.687150 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.687300 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.687503 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.687662 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.687805 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.687952 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.688102 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.688322 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.688476 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.688618 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.688770 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.688920 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.689121 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.689300 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.689445 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.689445 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.689723 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.689874 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.690015 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.690156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.690313 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.690465 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.690606 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.690771 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.690771 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.691040 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.691181 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.691334 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.691486 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.691629 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.691770 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.691919 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.692137 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.692333 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.692483 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.692633 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.692798 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.692941 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.693089 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.693244 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.693396 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.693547 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.693689 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.693838 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.693993 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.694294 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.694450 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.694594 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.695309 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.695481 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.695723 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.695946 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.696259 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.696259 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.696697 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.696848 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.697010 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.697010 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.697310 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.697468 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.697618 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.697773 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.697924 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.698080 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.698223 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.698372 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.698521 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.698664 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.698807 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.698960 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.699103 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 09:09:23.699252 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.699402 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.699552 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.699704 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.699861 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.700004 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.700145 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.700313 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.700466 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.700623 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.700771 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.700920 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.700920 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.701197 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.701346 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.701346 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.701648 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.701792 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.701935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.702077 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.702218 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.702379 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.702531 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.702682 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.702836 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.702978 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.703120 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.703270 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.703423 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.703606 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.703760 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.703909 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.704062 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.704232 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.704510 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.704660 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.704803 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.705000 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.705228 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.705411 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.705564 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.705564 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.705854 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.706003 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.706413 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.706576 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.706805 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.706960 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.707112 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.707256 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.707415 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.707580 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.707724 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.707883 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.708035 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.708277 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.708459 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.708604 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.708746 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.708894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.709044 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.709200 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.709350 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.709493 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.709640 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.709783 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.709934 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.710165 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.711128 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.711419 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.711566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.711728 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.711912 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.712067 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.712229 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.712229 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.712518 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.712662 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.712818 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.712976 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.713194 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.713359 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.713576 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.713744 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.713936 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.714094 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.714237 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.714387 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.714548 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.714835 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.715002 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.715146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.715301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.715451 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.715601 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.715744 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.715896 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.716047 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.716235 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.716405 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.716557 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.716710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.716961 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.717118 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.717276 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.717451 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.717611 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.717611 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.717912 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.718068 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.718224 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.718374 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.718529 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.718692 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.718842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.718990 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.719153 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.719321 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.719471 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.719627 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.719785 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.719935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.720084 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.720265 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.720431 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.720588 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.720746 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.720902 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.721051 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.721051 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.721351 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.721500 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.721657 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.721806 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.721954 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.722109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.722267 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.722423 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.722574 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.722722 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.722877 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.723034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.723203 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.723370 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.723544 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.723768 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.723949 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.724107 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.724324 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.724484 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.724641 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.724791 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.725082 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.725252 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.725412 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.725581 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.725739 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.725996 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.726237 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.726472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.726718 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.726718 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.727227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.727227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.727535 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.727744 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.727908 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.728068 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.728257 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.728257 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.728557 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.728720 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.728881 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.729030 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.729179 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.729335 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.729494 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.729651 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.729808 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.729965 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.730122 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.730284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.730447 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.730598 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.730747 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.730904 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.731061 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.731212 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.731371 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.731529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.731678 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.731834 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.731984 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.731984 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.732323 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.732482 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.732633 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.732781 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.732937 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.733103 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.733258 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.733408 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.733563 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.733712 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.733861 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.734027 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.734178 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.734337 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.734493 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.734642 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.734791 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.734791 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.735106 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.735379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.735545 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.735702 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.735954 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.736129 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.736350 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.736513 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.736662 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.736821 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.736980 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.737130 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.737385 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.737541 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.737691 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.737846 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.738009 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.738166 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.738316 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.738316 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.738614 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.738770 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.738934 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.738934 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.739217 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.739364 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.739511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.739668 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.739829 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.739980 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.740135 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.740307 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.740456 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.740616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.740780 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.740938 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.741094 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.741250 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.741400 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.741726 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.741949 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.742152 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.742407 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.742407 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.742789 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.742993 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.743176 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.743328 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.743477 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.743625 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.743775 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.743937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.743937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.744273 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.744430 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.744578 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.744726 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.744892 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.745042 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.745201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.745349 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.745659 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.745829 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.745989 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.746138 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.746295 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.746452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.746602 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.746764 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.746916 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.747073 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.747230 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.748845 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.749031 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.749820 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.749986 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.750142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.750293 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.750444 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.750609 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.750768 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.750919 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.751067 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.751229 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.751389 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.751389 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.751698 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.751858 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.752017 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.752432 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.752594 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.752753 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.752905 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.753233 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.753549 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.753701 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.756455 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.756716 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.756903 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.757069 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.757069 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.758806 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.759135 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.759318 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.759485 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.759649 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.759810 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.759962 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.760121 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.760344 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.760511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.760672 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.760831 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.760990 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.761147 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.761297 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.761477 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.761629 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.761779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.761941 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.762100 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.762251 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.762400 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.762567 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.762728 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.762887 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.763039 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.763189 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.763346 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.763526 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.763526 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.763845 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.763998 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.764154 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.764331 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.764492 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.764659 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.764812 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.764960 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.765108 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.765108 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.765410 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.765570 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.765720 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.765870 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.766019 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.766167 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.766333 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.766627 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.766801 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.766956 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.767113 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.767264 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.767420 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.767594 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.767746 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.767897 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.768046 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.768263 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.768430 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.768581 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.768731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.768886 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.768886 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.769283 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.769450 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.769602 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.769771 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.769922 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.770073 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.770221 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.770379 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.770541 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.770692 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.770842 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.770842 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.771151 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.771302 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.771450 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.771617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.771768 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.771917 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.772120 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.772296 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.772447 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.772608 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.772758 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.773483 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.773697 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.773941 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.774198 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.774445 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.774631 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.774785 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.774944 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.775095 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.775254 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.775418 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.775577 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.775727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.775877 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.776034 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.776204 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.776379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.776530 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.776833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.776992 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.777150 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.777301 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.777461 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.777612 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.777770 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.777920 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.778069 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.778219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.778389 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.778549 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.778700 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.778862 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.779021 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.779274 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.779532 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.779689 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.779838 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.779988 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.780145 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.780344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.780497 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.780655 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.780805 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.780969 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.781130 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.781292 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.781443 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.781600 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.781749 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.781905 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.782063 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.782226 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.782385 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.782543 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.782694 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.782843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.783011 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.783161 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.783321 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.783484 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.783641 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.783825 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.783991 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.784143 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.784331 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.784481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.784647 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.784807 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.784966 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.785136 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.785136 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.785136 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.785555 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.785717 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.785876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.786034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.786184 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.786333 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.786482 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.786709 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.786887 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.787177 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.787353 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.787505 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.787662 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.787823 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.787975 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.788124 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.788342 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.789090 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.789329 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.789329 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.789982 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.790153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.790321 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.790485 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.790650 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.790650 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.790944 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.791103 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.791253 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.791403 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.791567 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.791725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.791881 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.792040 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.792211 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.792380 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.792548 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.792700 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.792850 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.792999 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.793156 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.793307 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.793477 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.793634 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.793784 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.793941 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.794114 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.794265 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.794438 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.794588 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.794745 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.794894 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.795050 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.795214 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.795364 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.795513 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.795662 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.795817 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.795974 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.796138 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.796138 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.796138 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.796658 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.796816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.796967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.797125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.797426 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.797583 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.797732 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.797881 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.798039 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.798198 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.798358 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.798516 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.798676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.798833 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.798992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.799143 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.799301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.799459 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.799459 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.799759 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.799938 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.800269 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.800441 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.800599 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.800757 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.800917 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.801081 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.801232 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.801381 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.801532 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.801688 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.801838 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.801995 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.802146 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.802302 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.802452 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.802610 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.802788 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.802946 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.803097 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.803245 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.803401 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.803401 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.803710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.803867 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.804052 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.806156 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.806341 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.806525 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.806715 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.806884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.807043 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.807195 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.807353 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.807353 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.807353 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.807935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.808086 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.808297 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.808458 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.808458 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.808762 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.808913 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.809082 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.809233 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.809381 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.809544 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.809695 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.809845 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.810003 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.810172 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.810410 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.810580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.810732 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.810881 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.810881 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.811175 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.811325 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.811492 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.811642 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.811642 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.811936 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.812085 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.812269 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.812423 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.812580 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.812730 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.812879 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.813047 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.813211 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.813370 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.813544 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.813702 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.813853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.814002 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.814164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.814315 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.814463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.814611 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.814611 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.814900 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.815070 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.815222 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.815379 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.815535 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.815685 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.815843 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.815985 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.816075 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.816154 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.816154 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.816154 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.816392 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.816480 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.816562 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.816652 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.816744 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.816828 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.816919 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.817000 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.817080 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.817165 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.817244 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.817324 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.817405 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.817484 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.817561 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.817657 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.817747 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.817904 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.817980 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.818051 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.818129 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.818201 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.818278 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.818364 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.818443 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.818515 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.818585 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.818656 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.818726 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.818805 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.818885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.818957 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.819027 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.819098 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.819098 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.819241 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.819315 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.819393 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.819465 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.819534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.819613 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.819723 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.819797 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.819867 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.819979 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.820146 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.820329 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.820796 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.820894 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.820894 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.820894 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.820894 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.820894 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.821205 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.821283 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.821355 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.821435 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.821507 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.821577 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.821654 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.821726 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.821726 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.821861 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.821939 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.822019 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.822092 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.822169 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.822241 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.822320 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.822400 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.822472 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.822542 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.822618 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.822618 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.822755 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.822835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.822913 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.822913 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.823049 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.823129 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.823203 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.823280 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.823351 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.823351 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.823486 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.823565 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.823644 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.823723 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.823795 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.823866 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.823936 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.824057 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.824142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.824417 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.824510 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.824753 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.824847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.825072 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.825163 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.825427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.825509 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.825745 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.825880 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.826057 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.826140 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.826370 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.826468 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.826701 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.826807 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.827009 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.827092 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.827325 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.827673 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.827869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.827967 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.829254 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.829428 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.829428 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.829727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.829886 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.830045 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.830196 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.830345 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.830493 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.830700 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.830994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.831424 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.831578 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.831727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.831895 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.832054 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.832239 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.832396 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.832554 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.832711 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.832862 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.833020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.833179 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.833330 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.833480 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.833630 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.833780 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.833949 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.834100 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.834250 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.834399 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.834548 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.834712 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.834881 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.835033 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.835182 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.835910 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.836256 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.836524 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.836888 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.837214 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.837398 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.837646 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.837801 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.837950 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.838135 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.838330 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.838498 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.838650 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.838801 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.838964 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.838964 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.838964 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.839411 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.839568 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.839721 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.839915 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.840069 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.840386 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.840544 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.840694 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.840694 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.841010 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.841288 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.841445 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.841606 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.841764 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.841915 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.842074 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.842233 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.842391 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.842586 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.842759 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.842921 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.843073 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.843290 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.843455 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.843614 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.843614 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.843918 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.844079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.844264 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.844417 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.844566 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.844714 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.844872 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.845028 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.845185 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.845338 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.845497 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.845653 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.845653 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.845964 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.846115 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.846316 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.846497 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.846658 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.846809 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.846968 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.847117 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.847383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.847540 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.847824 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.848001 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.848153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.848331 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.848480 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.848631 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.848796 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.848948 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.849097 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.849246 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.849403 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.849566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.849566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.849874 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.849874 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.850179 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.850329 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.850494 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.850494 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.850796 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.851007 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.851165 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.851554 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.851817 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.852083 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.852298 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.852464 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.852626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.852777 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.852943 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.853098 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.853247 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.853247 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.853547 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.853547 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.853848 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.853997 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.854154 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.854316 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.854474 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.854637 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.854797 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.854949 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.855107 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.855277 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.855442 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.855593 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.855743 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.855899 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.856051 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.856229 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.856398 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.856550 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.856709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.856859 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.857009 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.857167 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.857318 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.857578 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.857743 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.858000 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.858158 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.858332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.858492 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.858649 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.858807 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.858958 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.859109 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.859271 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.859271 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.859565 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.859714 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.859714 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.860005 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.860197 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.860357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.860507 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.860674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.860832 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.860995 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.861152 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.861304 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.861460 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.861739 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.861905 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.862070 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.862221 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.862383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.862534 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.862684 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.862684 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.862992 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.863143 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.863292 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.863292 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.863576 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.863739 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.863890 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.864039 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.864258 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.864416 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.864566 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.864566 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.864863 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.865026 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.865185 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.865185 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.865484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.865644 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.865801 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.865964 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.866122 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.866282 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.866439 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.866603 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.867303 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.867466 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.867844 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.868272 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.868618 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.868803 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.868965 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.869132 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.869293 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.869444 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.869444 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.869766 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.869925 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.870082 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.870240 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.870402 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.870571 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.870731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.870882 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.871031 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.871188 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.871338 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.871516 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.871667 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.871956 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.872124 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.872368 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.872530 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.872691 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.872842 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.873000 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.873774 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.873937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.874089 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.874251 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.874251 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.874561 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.874721 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.874880 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.875053 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.875210 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.875373 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.875577 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.875758 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.875947 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.876106 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.876303 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.876467 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.876620 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.876782 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.876936 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.877085 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.877245 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.877414 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.877414 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.877720 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.877994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.878171 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.878418 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.878600 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.878760 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.878911 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.879069 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.879220 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.879385 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.879536 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.879693 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.879845 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.880001 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.880154 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.880348 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.880348 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.880648 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.880805 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.880805 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.881090 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.881257 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.881409 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.881560 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.881710 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.881861 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.882203 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.882904 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.883125 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.883353 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.883619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.883867 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.884059 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.884267 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.884267 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.884574 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.884777 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.884952 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.885119 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.885280 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.885438 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.885605 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.885768 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.885936 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.885936 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.886241 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.886401 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.886553 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.886703 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.886863 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.887024 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.887183 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.887589 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.887746 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.887896 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.888021 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.888111 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.888226 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.888314 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.888612 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.888718 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.888963 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.889059 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.889135 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.889215 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.889295 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.889295 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.889295 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.889295 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.889295 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.889295 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.889747 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.889856 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.889991 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.890094 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.890219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.890322 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.890538 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.890642 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.890856 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.891051 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.891173 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.891421 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.891523 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.891752 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.891854 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.892089 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.892243 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.892490 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.892635 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.892809 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.892926 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.893139 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.893330 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.893435 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.893663 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.893770 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.893994 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.894087 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.894318 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.894410 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.894640 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.894742 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.894962 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.895076 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.895284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.895390 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.895608 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.895705 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.895947 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.896251 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.896359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.896575 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.896669 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.896903 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.897030 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.897347 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.897464 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.897562 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.897656 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.898007 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.898161 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.898300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.898468 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.898708 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.898843 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.898931 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.899013 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.899316 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.899569 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.899677 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.899918 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.900011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.900268 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.900374 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.900603 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.900703 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.900915 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.901016 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.901226 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.901318 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.901537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.901637 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.901850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.901942 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.902177 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.902280 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.902494 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.902611 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.902802 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.902894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.903112 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.903214 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.903431 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.903543 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.903739 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.903859 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.904052 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.904248 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.904390 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.904519 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.904702 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.904835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.905017 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.905157 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.905325 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.905456 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.905635 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.905761 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.905944 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.906077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.906258 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.906388 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.906566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.906702 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.906876 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.907014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.907196 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.907327 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.907505 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.907656 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.907814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.907969 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.908121 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.908285 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.908479 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.908600 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.908910 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.909134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.909477 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.909898 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.909998 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.910124 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.910218 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.911106 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.911264 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.911264 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.911416 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.911416 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.911575 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.911650 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.911722 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.911794 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.911872 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.912005 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.912089 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.912346 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.912504 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.914070 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.914273 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.914445 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.914603 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.914710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.914710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.914888 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.914990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.915078 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.915170 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.915265 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.915358 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.915444 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.915539 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.915633 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.915728 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.915815 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.915906 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.915992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.916079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.916245 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.917330 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.917439 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.917517 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.917606 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.917682 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.917779 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.917896 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.917978 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.918058 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.918187 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.918297 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.918378 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.918451 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.918522 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.918600 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.918681 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.918763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.918895 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.918991 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.919219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.919321 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.919613 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.919730 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.919845 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.919928 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.920219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.920331 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.920511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.920604 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.920842 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.920934 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.921161 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.921267 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.921474 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.921573 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.921799 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.921897 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.922117 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.922218 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.922435 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.922528 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.922760 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.922853 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.923084 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.923178 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.923418 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.923506 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.923734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.923839 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.924047 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.924182 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.924385 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.924495 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.924629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 09:09:23.924759 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.925121 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.925444 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.925796 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.926130 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.926453 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.926773 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.927085 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 09:09:23.927335 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 09:09:23.988139 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO dbcounter [None req-3e019d01-720c-4412-aaae-2d5ccfc65f18 None None] Registered counter for database nova_api Aug 02 09:09:23.991598 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO dbcounter [None req-cbf28734-64f0-4e48-899d-3d26f643cbea None None] Registered counter for database nova_api Aug 02 09:09:24.009710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_db.sqlalchemy.engines [None req-3e019d01-720c-4412-aaae-2d5ccfc65f18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:09:24.012067 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_db.sqlalchemy.engines [None req-cbf28734-64f0-4e48-899d-3d26f643cbea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118525) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:09:24.016876 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writer thread running {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:09:24.018893 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writer thread running {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:09:24.075244 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.context [None req-3e019d01-720c-4412-aaae-2d5ccfc65f18 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),894ae206-7d3e-4ce6-b69d-0b2312fd81e0(cell1) {{(pid=118526) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 09:09:24.076724 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.context [None req-cbf28734-64f0-4e48-899d-3d26f643cbea None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),894ae206-7d3e-4ce6-b69d-0b2312fd81e0(cell1) {{(pid=118525) load_cells /opt/stack/nova/nova/context.py:464}} Aug 02 09:09:24.079521 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3e019d01-720c-4412-aaae-2d5ccfc65f18 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:24.080878 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cbf28734-64f0-4e48-899d-3d26f643cbea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:24.081500 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3e019d01-720c-4412-aaae-2d5ccfc65f18 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:24.082329 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3e019d01-720c-4412-aaae-2d5ccfc65f18 None None] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:24.082758 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cbf28734-64f0-4e48-899d-3d26f643cbea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:24.083568 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cbf28734-64f0-4e48-899d-3d26f643cbea None None] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:09:24.084721 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3e019d01-720c-4412-aaae-2d5ccfc65f18 None None] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:24.085686 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cbf28734-64f0-4e48-899d-3d26f643cbea None None] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:09:24.086814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO dbcounter [None req-3e019d01-720c-4412-aaae-2d5ccfc65f18 None None] Registered counter for database nova_cell0 Aug 02 09:09:24.087706 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO dbcounter [None req-cbf28734-64f0-4e48-899d-3d26f643cbea None None] Registered counter for database nova_cell0 Aug 02 09:09:24.091085 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO dbcounter [None req-3e019d01-720c-4412-aaae-2d5ccfc65f18 None None] Registered counter for database nova_cell1 Aug 02 09:09:24.091926 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO dbcounter [None req-cbf28734-64f0-4e48-899d-3d26f643cbea None None] Registered counter for database nova_cell1 Aug 02 09:09:24.098939 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_db.sqlalchemy.engines [None req-3e019d01-720c-4412-aaae-2d5ccfc65f18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:09:24.100822 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_db.sqlalchemy.engines [None req-3e019d01-720c-4412-aaae-2d5ccfc65f18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:09:24.102927 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_db.sqlalchemy.engines [None req-cbf28734-64f0-4e48-899d-3d26f643cbea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118525) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:09:24.104868 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_db.sqlalchemy.engines [None req-cbf28734-64f0-4e48-899d-3d26f643cbea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118525) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:09:24.107378 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writer thread running {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:09:24.109502 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writer thread running {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:09:24.110496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writer thread running {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:09:24.113180 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writer thread running {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:09:24.263664 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO dbcounter [None req-3e019d01-720c-4412-aaae-2d5ccfc65f18 None None] Registered counter for database nova_cell0 Aug 02 09:09:24.269647 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO dbcounter [None req-cbf28734-64f0-4e48-899d-3d26f643cbea None None] Registered counter for database nova_cell0 Aug 02 09:09:24.270640 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_db.sqlalchemy.engines [None req-3e019d01-720c-4412-aaae-2d5ccfc65f18 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:09:24.278070 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_db.sqlalchemy.engines [None req-cbf28734-64f0-4e48-899d-3d26f643cbea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118525) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 09:09:24.282676 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writer thread running {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:09:24.286012 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writer thread running {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 09:09:24.614786 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: WARNING keystonemiddleware.auth_token [None req-cbf28734-64f0-4e48-899d-3d26f643cbea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 09:09:24.622886 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: WARNING keystonemiddleware.auth_token [None req-cbf28734-64f0-4e48-899d-3d26f643cbea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 09:09:24.626062 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: WARNING keystonemiddleware.auth_token [None req-3e019d01-720c-4412-aaae-2d5ccfc65f18 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 09:09:24.634542 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: WARNING keystonemiddleware.auth_token [None req-3e019d01-720c-4412-aaae-2d5ccfc65f18 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 09:09:24.980904 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: WARNING keystonemiddleware.auth_token [None req-cbf28734-64f0-4e48-899d-3d26f643cbea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 09:09:24.987060 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: WARNING keystonemiddleware.auth_token [None req-cbf28734-64f0-4e48-899d-3d26f643cbea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 09:09:24.993298 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56167efe49c0 pid: 118525 (default app) Aug 02 09:09:24.994890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: WARNING keystonemiddleware.auth_token [None req-3e019d01-720c-4412-aaae-2d5ccfc65f18 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 02 09:09:25.001156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: WARNING keystonemiddleware.auth_token [None req-3e019d01-720c-4412-aaae-2d5ccfc65f18 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 02 09:09:25.006513 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56167efe49c0 pid: 118526 (default app) Aug 02 09:10:14.201949 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=3 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:14.203212 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=3 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:14.204116 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=3 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:14.205317 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=3 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:16.988232 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-95cf4f5a-cfa2-4bdf-9e4d-7bbb763eb818 tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Action: 'create', calling method: .version_select at 0x7ffba0b27f70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-832007915"}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:20.752413 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-95cf4f5a-cfa2-4bdf-9e4d-7bbb763eb818 tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 6.563096 Aug 02 09:10:20.764565 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Aug 2 09:10:14 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 6568 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 02 09:10:21.512040 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-24f5232d-fb0a-4b60-bcc6-4623c5bafcc2 tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Calling method '.version_select at 0x7ffba0c09a60>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:21.623141 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=3 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:21.625262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=3 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:21.626869 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=3 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:21.628971 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=3 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:23.061759 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-24f5232d-fb0a-4b60-bcc6-4623c5bafcc2 tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b8cbf29f-af01-4d32-8afe-0b96a48869e9" status: 200 len: 345 microversion: 2.1 time: 2.283020 Aug 02 09:10:23.068829 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 1/2] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 2 09:10:20 2022] GET /compute/v2.1/os-volumes/b8cbf29f-af01-4d32-8afe-0b96a48869e9 => generated 345 bytes in 2295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:10:23.081338 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-beac6e54-9543-4b1d-87b4-c692b733bf65 tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Action: 'create', calling method: .version_select at 0x7ffba09a7d30>, body: {"snapshot": {"volume_id": "b8cbf29f-af01-4d32-8afe-0b96a48869e9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1663154556"}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:24.581243 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-beac6e54-9543-4b1d-87b4-c692b733bf65 tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.509065 Aug 02 09:10:24.582861 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 2/3] 10.222.0.20 () {60 vars in 1162 bytes} [Tue Aug 2 09:10:23 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:10:24.598783 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c8d594b7-970d-4361-9c48-63fa69c48c16 tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Calling method '.version_select at 0x7ffba0a57d30>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:24.704264 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-c8d594b7-970d-4361-9c48-63fa69c48c16 tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a8bdb45f-8638-4687-be37-a393981a5f27" status: 200 len: 287 microversion: 2.1 time: 0.111860 Aug 02 09:10:24.716042 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 2 09:10:24 2022] GET /compute/v2.1/os-snapshots/a8bdb45f-8638-4687-be37-a393981a5f27 => generated 287 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:10:24.722496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-1e12a103-6c13-44d7-ad50-42d623a5be0f tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Calling method '.version_select at 0x7ffba09b9e50>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:24.962613 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-1e12a103-6c13-44d7-ad50-42d623a5be0f tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.246688 Aug 02 09:10:24.968573 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 3/5] 10.222.0.20 () {58 vars in 1140 bytes} [Tue Aug 2 09:10:24 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:10:24.977822 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c749b2ee-2f36-42cd-9abc-637f8a146f9b tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Calling method '.version_select at 0x7ffba0a57940>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:25.037532 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-c749b2ee-2f36-42cd-9abc-637f8a146f9b tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a8bdb45f-8638-4687-be37-a393981a5f27" status: 200 len: 287 microversion: 2.1 time: 0.064293 Aug 02 09:10:25.038560 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 3/6] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 2 09:10:24 2022] GET /compute/v2.1/os-snapshots/a8bdb45f-8638-4687-be37-a393981a5f27 => generated 287 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:10:26.051738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-88a780fb-5f3a-40fd-8705-82659504da10 tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Calling method '.version_select at 0x7ffba09b9ca0>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:26.151756 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-88a780fb-5f3a-40fd-8705-82659504da10 tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a8bdb45f-8638-4687-be37-a393981a5f27" status: 200 len: 287 microversion: 2.1 time: 0.104288 Aug 02 09:10:26.153191 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 2 09:10:26 2022] GET /compute/v2.1/os-snapshots/a8bdb45f-8638-4687-be37-a393981a5f27 => generated 287 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:10:27.170900 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-7c4ea3f1-9ff2-444c-b8a6-3239f4d3c2fe tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Calling method '.version_select at 0x7ffba09a5550>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:27.346271 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-7c4ea3f1-9ff2-444c-b8a6-3239f4d3c2fe tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a8bdb45f-8638-4687-be37-a393981a5f27" status: 200 len: 287 microversion: 2.1 time: 0.180189 Aug 02 09:10:27.346893 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 2 09:10:27 2022] GET /compute/v2.1/os-snapshots/a8bdb45f-8638-4687-be37-a393981a5f27 => generated 287 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:10:28.372676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-f66b4ea2-9979-4685-a792-d82f53c7969c tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Calling method '.version_select at 0x7ffba09b94c0>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:28.493643 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-f66b4ea2-9979-4685-a792-d82f53c7969c tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a8bdb45f-8638-4687-be37-a393981a5f27" status: 200 len: 288 microversion: 2.1 time: 0.127477 Aug 02 09:10:28.504918 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 5/9] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 2 09:10:28 2022] GET /compute/v2.1/os-snapshots/a8bdb45f-8638-4687-be37-a393981a5f27 => generated 288 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:10:28.515611 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a7383084-beff-4102-8735-6f618e43fb22 tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Calling method '.version_select at 0x7ffba09a5c10>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:28.743411 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-a7383084-beff-4102-8735-6f618e43fb22 tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/a8bdb45f-8638-4687-be37-a393981a5f27" status: 202 len: 0 microversion: 2.1 time: 0.235276 Aug 02 09:10:28.767836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 5/10] 10.222.0.20 () {58 vars in 1254 bytes} [Tue Aug 2 09:10:28 2022] DELETE /compute/v2.1/os-snapshots/a8bdb45f-8638-4687-be37-a393981a5f27 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:10:28.775820 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-32a1bc57-d5e7-4d03-a1fb-c1981090a81c tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Calling method '.version_select at 0x7ffba09a7e50>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:28.900683 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-32a1bc57-d5e7-4d03-a1fb-c1981090a81c tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a8bdb45f-8638-4687-be37-a393981a5f27" status: 200 len: 287 microversion: 2.1 time: 0.146763 Aug 02 09:10:28.912803 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 6/11] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 2 09:10:28 2022] GET /compute/v2.1/os-snapshots/a8bdb45f-8638-4687-be37-a393981a5f27 => generated 287 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:10:29.675312 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b07f7f27-06ff-443a-8cb0-a9cb6c8d98c9 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-904381666", "imageRef": "7a52f4c5-c531-494a-b375-4f6dce3abbc2", "flavorRef": "452", "networks": [{"uuid": "a6744bfe-c1c8-42f6-ba29-e7c231712dd7"}]}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:29.926812 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-a645df86-85c0-4bde-9fc0-c59b55e0fc22 tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Calling method '.version_select at 0x7ffba09a7f70>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:30.059601 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-a645df86-85c0-4bde-9fc0-c59b55e0fc22 tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a8bdb45f-8638-4687-be37-a393981a5f27" status: 200 len: 287 microversion: 2.1 time: 0.142231 Aug 02 09:10:30.062717 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 7/12] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 2 09:10:29 2022] GET /compute/v2.1/os-snapshots/a8bdb45f-8638-4687-be37-a393981a5f27 => generated 287 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:10:30.113565 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.network.neutron [None req-b07f7f27-06ff-443a-8cb0-a9cb6c8d98c9 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] validate_networks() for [('a6744bfe-c1c8-42f6-ba29-e7c231712dd7', None, None, None, None, None)] {{(pid=118526) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:10:31.086453 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-5631384f-7402-4164-abd2-66475806d57f tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Calling method '.version_select at 0x7ffba09b9700>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:31.291359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-5631384f-7402-4164-abd2-66475806d57f tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a8bdb45f-8638-4687-be37-a393981a5f27" status: 200 len: 287 microversion: 2.1 time: 0.216747 Aug 02 09:10:31.293540 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 8/13] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 2 09:10:31 2022] GET /compute/v2.1/os-snapshots/a8bdb45f-8638-4687-be37-a393981a5f27 => generated 287 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:10:32.311403 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-5f9b44b4-9e16-4e4b-b88e-cb428e18077a tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Calling method '.version_select at 0x7ffba09b9d30>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:32.452440 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-5f9b44b4-9e16-4e4b-b88e-cb428e18077a tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] HTTP exception thrown: Snapshot a8bdb45f-8638-4687-be37-a393981a5f27 could not be found. Aug 02 09:10:32.459894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-5f9b44b4-9e16-4e4b-b88e-cb428e18077a tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Request method failure captured: Aug 02 09:10:32.459894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: GET /compute/v2.1/os-snapshots/a8bdb45f-8638-4687-be37-a393981a5f27 HTTP/1.1 Aug 02 09:10:32.459894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:10:32.459894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:10:32.459894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:10:32.459894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:10:32.459894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:10:32.459894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:10:32.459894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:10:32.459894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:10:32.459894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6On2JhpqE0sOyq4Xm_KwoFAb7owneC2xsmRCS8jP7A-X-2HjpyXcVptZO3t9OB8ADAhW_ZRGwm7zwQRPqEiPpOPClsuEacmjo_ypVc_okeoLah64HE5LEUSX1Gm8OVc25oe7FjbQdp29YGRZlww7j3NzovIT3DqX_JXsbkMFQB94vOw Aug 02 09:10:32.459894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:10:32.459894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:10:32.459894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:10:32.459894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:10:32.459894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:10:32.459894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:10:32.459894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: 6face5ff38704f6fb2b2c17eeeaea1b8 Aug 02 09:10:32.459894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-718460161 Aug 02 09:10:32.459894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:10:32.459894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:10:32.461420 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6face5ff38704f6fb2b2c17eeeaea1b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6face5ff38704f6fb2b2c17eeeaea1b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6face5ff38704f6fb2b2c17eeeaea1b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6face5ff38704f6fb2b2c17eeeaea1b8"}]}] Aug 02 09:10:32.461420 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-VolumesSnapshotsTestJSON-718460161 Aug 02 09:10:32.461420 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: 6face5ff38704f6fb2b2c17eeeaea1b8 Aug 02 09:10:32.461420 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-718460161 Aug 02 09:10:32.461420 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-VolumesSnapshotsTestJSON-718460161-project Aug 02 09:10:32.461420 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:10:32.461420 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:10:32.461420 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: 5fc3c9af90504357b9f09ca0ebeb4bcc Aug 02 09:10:32.461420 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-VolumesSnapshotsTestJSON-718460161-project Aug 02 09:10:32.461420 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: Aug 02 09:10:32.461420 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Snapshot a8bdb45f-8638-4687-be37-a393981a5f27 could not be found. Aug 02 09:10:32.461420 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': 'a8bdb45f-8638-4687-be37-a393981a5f27'} Aug 02 09:10:32.461420 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:10:32.462153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:32.462153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 02 09:10:32.462153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 02 09:10:32.462153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 02 09:10:32.462153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 02 09:10:32.462153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 02 09:10:32.462153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 02 09:10:32.462153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:10:32.462153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:10:32.462153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:10:32.462153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:10:32.462153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:10:32.462153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:10:32.462153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:10:32.462153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:10:32.462153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a8bdb45f-8638-4687-be37-a393981a5f27 could not be found. (HTTP 404) (Request-ID: req-4b3031c7-4486-43c4-b3b2-36e425d7d860) Aug 02 09:10:32.462153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:32.462153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:32.463119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:32.463119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:32.463119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 02 09:10:32.463119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 02 09:10:32.463119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:10:32.463119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:10:32.463119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 02 09:10:32.463119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 02 09:10:32.463119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:10:32.463119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:10:32.463119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 02 09:10:32.463119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 02 09:10:32.463119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 02 09:10:32.463119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 02 09:10:32.463119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 02 09:10:32.463119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 02 09:10:32.463119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:10:32.463119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:10:32.463119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:10:32.469731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:10:32.469731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:10:32.469731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:10:32.469731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:10:32.469731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:10:32.469731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a8bdb45f-8638-4687-be37-a393981a5f27 could not be found. Aug 02 09:10:32.469731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:32.469731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:32.469731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:32.469731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:32.469731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:32.469731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:32.469731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:10:32.469731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:10:32.469731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:10:32.469731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:10:32.469731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:10:32.469731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:10:32.469731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 02 09:10:32.469731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:10:32.472251 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a8bdb45f-8638-4687-be37-a393981a5f27 could not be found. Aug 02 09:10:32.472251 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:32.472251 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:32.472251 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:32.472251 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:32.472251 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:32.472251 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:32.472251 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:10:32.472251 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:10:32.472251 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a8bdb45f-8638-4687-be37-a393981a5f27 could not be found. Aug 02 09:10:32.472251 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:32.472251 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-5f9b44b4-9e16-4e4b-b88e-cb428e18077a tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Returning 404 to user: Snapshot a8bdb45f-8638-4687-be37-a393981a5f27 could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:10:32.472251 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-5f9b44b4-9e16-4e4b-b88e-cb428e18077a tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/a8bdb45f-8638-4687-be37-a393981a5f27" status: 404 len: 111 microversion: 2.1 time: 0.155468 Aug 02 09:10:32.472251 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 9/14] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 2 09:10:32 2022] GET /compute/v2.1/os-snapshots/a8bdb45f-8638-4687-be37-a393981a5f27 => generated 111 bytes in 160 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 09:10:32.487929 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-e32f5dae-f22d-4c74-b5fd-ccad584a3cee tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Calling method '.version_select at 0x7ffba09be8b0>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:32.806147 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-e32f5dae-f22d-4c74-b5fd-ccad584a3cee tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/b8cbf29f-af01-4d32-8afe-0b96a48869e9" status: 202 len: 0 microversion: 2.1 time: 0.336425 Aug 02 09:10:32.807470 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 10/15] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 2 09:10:32 2022] DELETE /compute/v2.1/os-volumes/b8cbf29f-af01-4d32-8afe-0b96a48869e9 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:10:32.824670 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-1fc43bb5-d57c-4301-a120-f5519b8596ee tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Calling method '.version_select at 0x7ffba09bedc0>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:33.054404 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-1fc43bb5-d57c-4301-a120-f5519b8596ee tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b8cbf29f-af01-4d32-8afe-0b96a48869e9" status: 200 len: 344 microversion: 2.1 time: 0.241764 Aug 02 09:10:33.063895 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 11/16] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 2 09:10:32 2022] GET /compute/v2.1/os-volumes/b8cbf29f-af01-4d32-8afe-0b96a48869e9 => generated 344 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:10:34.091357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-334cddde-394e-456b-9ff8-bb273f27267c tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Calling method '.version_select at 0x7ffba09be280>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:34.206756 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-334cddde-394e-456b-9ff8-bb273f27267c tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] HTTP exception thrown: Volume b8cbf29f-af01-4d32-8afe-0b96a48869e9 could not be found. Aug 02 09:10:34.218828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-334cddde-394e-456b-9ff8-bb273f27267c tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Request method failure captured: Aug 02 09:10:34.218828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: GET /compute/v2.1/os-volumes/b8cbf29f-af01-4d32-8afe-0b96a48869e9 HTTP/1.1 Aug 02 09:10:34.218828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:10:34.218828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:10:34.218828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:10:34.218828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:10:34.218828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:10:34.218828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:10:34.218828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:10:34.218828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:10:34.218828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6On2JhpqE0sOyq4Xm_KwoFAb7owneC2xsmRCS8jP7A-X-2HjpyXcVptZO3t9OB8ADAhW_ZRGwm7zwQRPqEiPpOPClsuEacmjo_ypVc_okeoLah64HE5LEUSX1Gm8OVc25oe7FjbQdp29YGRZlww7j3NzovIT3DqX_JXsbkMFQB94vOw Aug 02 09:10:34.218828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:10:34.218828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:10:34.218828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:10:34.218828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:10:34.218828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:10:34.218828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:10:34.218828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: 6face5ff38704f6fb2b2c17eeeaea1b8 Aug 02 09:10:34.218828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-718460161 Aug 02 09:10:34.218828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:10:34.218828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:10:34.220115 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6face5ff38704f6fb2b2c17eeeaea1b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6face5ff38704f6fb2b2c17eeeaea1b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6face5ff38704f6fb2b2c17eeeaea1b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6face5ff38704f6fb2b2c17eeeaea1b8"}]}] Aug 02 09:10:34.220115 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-VolumesSnapshotsTestJSON-718460161 Aug 02 09:10:34.220115 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: 6face5ff38704f6fb2b2c17eeeaea1b8 Aug 02 09:10:34.220115 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-718460161 Aug 02 09:10:34.220115 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-VolumesSnapshotsTestJSON-718460161-project Aug 02 09:10:34.220115 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:10:34.220115 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:10:34.220115 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: 5fc3c9af90504357b9f09ca0ebeb4bcc Aug 02 09:10:34.220115 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-VolumesSnapshotsTestJSON-718460161-project Aug 02 09:10:34.220115 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: Aug 02 09:10:34.220115 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Volume b8cbf29f-af01-4d32-8afe-0b96a48869e9 could not be found. Aug 02 09:10:34.220115 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': 'b8cbf29f-af01-4d32-8afe-0b96a48869e9'} Aug 02 09:10:34.220115 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:10:34.220808 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:34.220808 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:10:34.220808 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:10:34.220808 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:10:34.220808 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:10:34.220808 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:10:34.220808 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:10:34.220808 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:10:34.220808 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:10:34.220808 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:10:34.220808 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:10:34.220808 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:10:34.220808 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:10:34.220808 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:10:34.220808 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:10:34.220808 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b8cbf29f-af01-4d32-8afe-0b96a48869e9 could not be found. (HTTP 404) (Request-ID: req-ab2e8fbe-7532-4749-a388-9002f8edb72c) Aug 02 09:10:34.220808 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:34.220808 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:34.220808 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:34.221727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:34.221727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 09:10:34.221727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 09:10:34.221727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:10:34.221727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:10:34.221727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 09:10:34.221727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 09:10:34.221727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:10:34.221727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:10:34.221727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:10:34.221727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:10:34.221727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:10:34.221727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:10:34.221727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:10:34.221727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:10:34.221727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:10:34.221727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:10:34.221727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:10:34.221727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:10:34.222622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:10:34.222622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:10:34.222622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:10:34.222622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:10:34.222622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b8cbf29f-af01-4d32-8afe-0b96a48869e9 could not be found. Aug 02 09:10:34.222622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:34.222622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:34.222622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:34.222622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:34.222622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:34.222622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:34.222622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:10:34.222622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:10:34.222622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:10:34.222622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:10:34.222622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:10:34.222622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:10:34.222622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 09:10:34.222622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:10:34.223481 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b8cbf29f-af01-4d32-8afe-0b96a48869e9 could not be found. Aug 02 09:10:34.223481 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:34.223481 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:34.223481 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:34.223481 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:34.223481 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:34.223481 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:34.223481 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:10:34.223481 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:10:34.223481 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b8cbf29f-af01-4d32-8afe-0b96a48869e9 could not be found. Aug 02 09:10:34.223481 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:34.223481 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-334cddde-394e-456b-9ff8-bb273f27267c tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Returning 404 to user: Volume b8cbf29f-af01-4d32-8afe-0b96a48869e9 could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:10:34.229400 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-334cddde-394e-456b-9ff8-bb273f27267c tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b8cbf29f-af01-4d32-8afe-0b96a48869e9" status: 404 len: 109 microversion: 2.1 time: 0.143667 Aug 02 09:10:34.231046 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 12/17] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 2 09:10:34 2022] GET /compute/v2.1/os-volumes/b8cbf29f-af01-4d32-8afe-0b96a48869e9 => generated 109 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:10:34.255338 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4d76240b-daf4-4d1f-ab8b-ff9373b8400d tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Calling method '.version_select at 0x7ffba093b550>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:34.330377 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-4d76240b-daf4-4d1f-ab8b-ff9373b8400d tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] HTTP exception thrown: Volume b8cbf29f-af01-4d32-8afe-0b96a48869e9 could not be found. Aug 02 09:10:34.334263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4d76240b-daf4-4d1f-ab8b-ff9373b8400d tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Request method failure captured: Aug 02 09:10:34.334263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: DELETE /compute/v2.1/os-volumes/b8cbf29f-af01-4d32-8afe-0b96a48869e9 HTTP/1.1 Aug 02 09:10:34.334263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:10:34.334263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:10:34.334263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:10:34.334263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:10:34.334263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:10:34.334263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:10:34.334263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:10:34.334263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:10:34.334263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6On2JhpqE0sOyq4Xm_KwoFAb7owneC2xsmRCS8jP7A-X-2HjpyXcVptZO3t9OB8ADAhW_ZRGwm7zwQRPqEiPpOPClsuEacmjo_ypVc_okeoLah64HE5LEUSX1Gm8OVc25oe7FjbQdp29YGRZlww7j3NzovIT3DqX_JXsbkMFQB94vOw Aug 02 09:10:34.334263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:10:34.334263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:10:34.334263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:10:34.334263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:10:34.334263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:10:34.334263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:10:34.334263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: 6face5ff38704f6fb2b2c17eeeaea1b8 Aug 02 09:10:34.334263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-718460161 Aug 02 09:10:34.334263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:10:34.334263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:10:34.335453 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6face5ff38704f6fb2b2c17eeeaea1b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6face5ff38704f6fb2b2c17eeeaea1b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6face5ff38704f6fb2b2c17eeeaea1b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6face5ff38704f6fb2b2c17eeeaea1b8"}]}] Aug 02 09:10:34.335453 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-VolumesSnapshotsTestJSON-718460161 Aug 02 09:10:34.335453 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: 6face5ff38704f6fb2b2c17eeeaea1b8 Aug 02 09:10:34.335453 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-718460161 Aug 02 09:10:34.335453 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-VolumesSnapshotsTestJSON-718460161-project Aug 02 09:10:34.335453 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:10:34.335453 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:10:34.335453 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: 5fc3c9af90504357b9f09ca0ebeb4bcc Aug 02 09:10:34.335453 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-VolumesSnapshotsTestJSON-718460161-project Aug 02 09:10:34.335453 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: Aug 02 09:10:34.335453 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Volume b8cbf29f-af01-4d32-8afe-0b96a48869e9 could not be found. Aug 02 09:10:34.335453 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': 'b8cbf29f-af01-4d32-8afe-0b96a48869e9'} Aug 02 09:10:34.335453 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:10:34.336876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:34.336876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:10:34.336876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:10:34.336876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 09:10:34.336876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 09:10:34.336876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 09:10:34.336876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 09:10:34.336876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 09:10:34.336876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 09:10:34.336876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 09:10:34.336876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 09:10:34.336876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:10:34.336876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:10:34.336876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:10:34.336876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:10:34.336876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b8cbf29f-af01-4d32-8afe-0b96a48869e9 could not be found. (HTTP 404) (Request-ID: req-d7e06e26-a71f-4a1c-acdf-2d73c1561542) Aug 02 09:10:34.336876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:34.336876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:34.336876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:34.348649 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:34.348649 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 09:10:34.348649 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 09:10:34.348649 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:10:34.348649 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:10:34.348649 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 09:10:34.348649 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 09:10:34.348649 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:10:34.348649 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:10:34.348649 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:10:34.348649 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:10:34.348649 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 09:10:34.348649 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 09:10:34.348649 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 09:10:34.348649 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 09:10:34.348649 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 09:10:34.348649 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 09:10:34.348649 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 09:10:34.348649 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 09:10:34.350357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:10:34.350357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:10:34.350357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:10:34.350357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:10:34.350357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b8cbf29f-af01-4d32-8afe-0b96a48869e9 could not be found. Aug 02 09:10:34.350357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:34.350357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:34.350357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:34.350357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:34.350357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:34.350357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:34.350357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:10:34.350357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:10:34.350357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:10:34.350357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:10:34.350357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:10:34.350357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:10:34.350357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 09:10:34.350357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:10:34.351568 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b8cbf29f-af01-4d32-8afe-0b96a48869e9 could not be found. Aug 02 09:10:34.351568 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:34.351568 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:34.351568 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:34.351568 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:34.351568 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:34.351568 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:34.351568 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:10:34.351568 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:10:34.351568 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b8cbf29f-af01-4d32-8afe-0b96a48869e9 could not be found. Aug 02 09:10:34.351568 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:34.351568 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4d76240b-daf4-4d1f-ab8b-ff9373b8400d tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Returning 404 to user: Volume b8cbf29f-af01-4d32-8afe-0b96a48869e9 could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:10:34.351568 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-4d76240b-daf4-4d1f-ab8b-ff9373b8400d tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/b8cbf29f-af01-4d32-8afe-0b96a48869e9" status: 404 len: 109 microversion: 2.1 time: 0.095947 Aug 02 09:10:34.351568 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 13/18] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 2 09:10:34 2022] DELETE /compute/v2.1/os-volumes/b8cbf29f-af01-4d32-8afe-0b96a48869e9 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:10:34.368887 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-05792c59-c6a3-4b5f-8b28-e4195a784b61 tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Calling method '.version_select at 0x7ffba09be3a0>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:34.426981 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-b07f7f27-06ff-443a-8cb0-a9cb6c8d98c9 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Flavor limits 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:10:34.427877 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-b07f7f27-06ff-443a-8cb0-a9cb6c8d98c9 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Image limits 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:10:34.428970 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-b07f7f27-06ff-443a-8cb0-a9cb6c8d98c9 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Flavor pref 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:10:34.430226 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-b07f7f27-06ff-443a-8cb0-a9cb6c8d98c9 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Image pref 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:10:34.431209 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-b07f7f27-06ff-443a-8cb0-a9cb6c8d98c9 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:10:34.452388 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-05792c59-c6a3-4b5f-8b28-e4195a784b61 tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] HTTP exception thrown: Volume b8cbf29f-af01-4d32-8afe-0b96a48869e9 could not be found. Aug 02 09:10:34.459164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-05792c59-c6a3-4b5f-8b28-e4195a784b61 tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Request method failure captured: Aug 02 09:10:34.459164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: GET /compute/v2.1/os-volumes/b8cbf29f-af01-4d32-8afe-0b96a48869e9 HTTP/1.1 Aug 02 09:10:34.459164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:10:34.459164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:10:34.459164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:10:34.459164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:10:34.459164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:10:34.459164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:10:34.459164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:10:34.459164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:10:34.459164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6On2JhpqE0sOyq4Xm_KwoFAb7owneC2xsmRCS8jP7A-X-2HjpyXcVptZO3t9OB8ADAhW_ZRGwm7zwQRPqEiPpOPClsuEacmjo_ypVc_okeoLah64HE5LEUSX1Gm8OVc25oe7FjbQdp29YGRZlww7j3NzovIT3DqX_JXsbkMFQB94vOw Aug 02 09:10:34.459164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:10:34.459164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:10:34.459164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:10:34.459164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:10:34.459164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:10:34.459164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:10:34.459164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: 6face5ff38704f6fb2b2c17eeeaea1b8 Aug 02 09:10:34.459164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-718460161 Aug 02 09:10:34.459164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:10:34.459164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:10:34.465496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6face5ff38704f6fb2b2c17eeeaea1b8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6face5ff38704f6fb2b2c17eeeaea1b8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6face5ff38704f6fb2b2c17eeeaea1b8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6face5ff38704f6fb2b2c17eeeaea1b8"}]}] Aug 02 09:10:34.465496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-VolumesSnapshotsTestJSON-718460161 Aug 02 09:10:34.465496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: 6face5ff38704f6fb2b2c17eeeaea1b8 Aug 02 09:10:34.465496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-718460161 Aug 02 09:10:34.465496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-VolumesSnapshotsTestJSON-718460161-project Aug 02 09:10:34.465496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:10:34.465496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:10:34.465496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: 5fc3c9af90504357b9f09ca0ebeb4bcc Aug 02 09:10:34.465496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-VolumesSnapshotsTestJSON-718460161-project Aug 02 09:10:34.465496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: Aug 02 09:10:34.465496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Volume b8cbf29f-af01-4d32-8afe-0b96a48869e9 could not be found. Aug 02 09:10:34.465496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': 'b8cbf29f-af01-4d32-8afe-0b96a48869e9'} Aug 02 09:10:34.465496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:10:34.466391 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:34.466391 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:10:34.466391 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:10:34.466391 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:10:34.466391 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:10:34.466391 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:10:34.466391 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:10:34.466391 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:10:34.466391 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:10:34.466391 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:10:34.466391 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:10:34.466391 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:10:34.466391 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:10:34.466391 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:10:34.466391 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:10:34.466391 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b8cbf29f-af01-4d32-8afe-0b96a48869e9 could not be found. (HTTP 404) (Request-ID: req-d994dd27-9342-40b3-bc19-7552796c7dbe) Aug 02 09:10:34.466391 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:34.466391 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:34.466391 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:34.468368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:34.468368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 09:10:34.468368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 09:10:34.468368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:10:34.468368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:10:34.468368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 09:10:34.468368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 09:10:34.468368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:10:34.468368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:10:34.468368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:10:34.468368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:10:34.468368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:10:34.468368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:10:34.468368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:10:34.468368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:10:34.468368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:10:34.468368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:10:34.468368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:10:34.468368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:10:34.470290 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:10:34.470290 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:10:34.470290 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:10:34.470290 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:10:34.470290 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b8cbf29f-af01-4d32-8afe-0b96a48869e9 could not be found. Aug 02 09:10:34.470290 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:34.470290 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:34.470290 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:34.470290 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:34.470290 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:34.470290 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:34.470290 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:10:34.470290 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:10:34.470290 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:10:34.470290 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:10:34.470290 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:10:34.470290 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:10:34.470290 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 09:10:34.470290 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:10:34.472259 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b8cbf29f-af01-4d32-8afe-0b96a48869e9 could not be found. Aug 02 09:10:34.472259 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:34.472259 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:34.472259 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:34.472259 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:34.472259 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:34.472259 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:34.472259 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:10:34.472259 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:10:34.472259 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b8cbf29f-af01-4d32-8afe-0b96a48869e9 could not be found. Aug 02 09:10:34.472259 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:34.478303 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-05792c59-c6a3-4b5f-8b28-e4195a784b61 tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] Returning 404 to user: Volume b8cbf29f-af01-4d32-8afe-0b96a48869e9 could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:10:34.480212 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-05792c59-c6a3-4b5f-8b28-e4195a784b61 tempest-VolumesSnapshotsTestJSON-718460161 tempest-VolumesSnapshotsTestJSON-718460161-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/b8cbf29f-af01-4d32-8afe-0b96a48869e9" status: 404 len: 109 microversion: 2.1 time: 0.128048 Aug 02 09:10:34.484854 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 14/19] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 2 09:10:34 2022] GET /compute/v2.1/os-volumes/b8cbf29f-af01-4d32-8afe-0b96a48869e9 => generated 109 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:10:34.532787 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b07f7f27-06ff-443a-8cb0-a9cb6c8d98c9 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:34.538193 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b07f7f27-06ff-443a-8cb0-a9cb6c8d98c9 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:34.547582 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b07f7f27-06ff-443a-8cb0-a9cb6c8d98c9 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:34.549284 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b07f7f27-06ff-443a-8cb0-a9cb6c8d98c9 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:34.728524 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-b07f7f27-06ff-443a-8cb0-a9cb6c8d98c9 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Getting quotas for project 53df83f23dcf439aae2c867c57df57e0. Resources: {'cores', 'ram', 'instances'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:10:34.752483 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-b07f7f27-06ff-443a-8cb0-a9cb6c8d98c9 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Getting quotas for user ed8d0b552b03417c9db1f5fc2bef05b2 and project 53df83f23dcf439aae2c867c57df57e0. Resources: {'cores', 'ram', 'instances'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:10:34.805494 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b07f7f27-06ff-443a-8cb0-a9cb6c8d98c9 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Going to run 1 instances... {{(pid=118526) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:10:34.825031 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b07f7f27-06ff-443a-8cb0-a9cb6c8d98c9 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7a52f4c5-c531-494a-b375-4f6dce3abbc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:10:35.316980 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b07f7f27-06ff-443a-8cb0-a9cb6c8d98c9 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.374048 Aug 02 09:10:35.333320 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 6/20] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 2 09:10:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 6396 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:10:35.362018 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-674d2234-c713-4b30-9406-e06498dea815 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:35.365853 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-674d2234-c713-4b30-9406-e06498dea815 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:35.709354 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-674d2234-c713-4b30-9406-e06498dea815 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:35.780563 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-674d2234-c713-4b30-9406-e06498dea815 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1214 microversion: 2.1 time: 0.441657 Aug 02 09:10:35.787027 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 7/21] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:35 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1214 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:36.538659 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-a8a5364d-df89-4162-b14d-9c93e46d021d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Action: 'create', calling method: .version_select at 0x7ffba09beb80>, body: {"keypair": {"name": "tempest-keypair-851894694", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGTfS8bOkASZsuxvDw1YP/BUUCLQl+qUJBpiNU9mCjCiLBfg26C5Af8cEeAHR74OJT6TCPbjUwsg+e/HSlQLQ+ui9O+EDJljZC9LmWuzpjiBgqsKf5t7WD5oD2XqMPFJwg=="}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:36.789700 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-a8a5364d-df89-4162-b14d-9c93e46d021d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Getting quotas for project b6fc6b07497a48eeb263b3a9b8aa7499. Resources: {'key_pairs'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:10:36.821667 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-a8a5364d-df89-4162-b14d-9c93e46d021d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Getting quotas for user ad3a9141e9284bb5a096fb04d3e9d581 and project b6fc6b07497a48eeb263b3a9b8aa7499. Resources: {'key_pairs'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:10:36.834733 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-7d6662cf-d739-4d6f-bad9-0dd096c1c67c tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:36.837444 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-7d6662cf-d739-4d6f-bad9-0dd096c1c67c tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:37.134328 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-a8a5364d-df89-4162-b14d-9c93e46d021d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 2.184170 Aug 02 09:10:37.138758 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 15/22] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 2 09:10:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 2190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:10:37.295990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-7d6662cf-d739-4d6f-bad9-0dd096c1c67c tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:37.331644 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-7d6662cf-d739-4d6f-bad9-0dd096c1c67c tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1214 microversion: 2.1 time: 0.509475 Aug 02 09:10:37.332980 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 8/23] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:36 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1214 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:38.385437 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-6c2b3885-ba7e-4c4b-a688-0a4dbc0b1e7a tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:38.387241 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-6c2b3885-ba7e-4c4b-a688-0a4dbc0b1e7a tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:38.725573 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-6c2b3885-ba7e-4c4b-a688-0a4dbc0b1e7a tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:38.767548 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-6c2b3885-ba7e-4c4b-a688-0a4dbc0b1e7a tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1214 microversion: 2.1 time: 0.393216 Aug 02 09:10:38.769960 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 16/24] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:38 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1214 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:39.834314 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-fd7b1645-0a58-4701-9e10-d29be4cf336f tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:39.840717 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-fd7b1645-0a58-4701-9e10-d29be4cf336f tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:40.072446 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-fd7b1645-0a58-4701-9e10-d29be4cf336f tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:40.093949 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-fd7b1645-0a58-4701-9e10-d29be4cf336f tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1214 microversion: 2.1 time: 0.276127 Aug 02 09:10:40.094902 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 9/25] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:39 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1214 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:41.123182 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-de404d65-4edc-4601-b85a-ea08084ca36d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:41.124465 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-de404d65-4edc-4601-b85a-ea08084ca36d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:41.438091 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-de404d65-4edc-4601-b85a-ea08084ca36d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:41.450770 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-de404d65-4edc-4601-b85a-ea08084ca36d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1214 microversion: 2.1 time: 0.329978 Aug 02 09:10:41.450770 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 17/26] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:41 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1214 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:42.479716 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-3168e4f5-26cb-43df-aacb-77bac708e0bb tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:42.489947 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-3168e4f5-26cb-43df-aacb-77bac708e0bb tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:42.527183 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3168e4f5-26cb-43df-aacb-77bac708e0bb tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:42.542641 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3168e4f5-26cb-43df-aacb-77bac708e0bb tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:42.548716 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3168e4f5-26cb-43df-aacb-77bac708e0bb tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:42.554681 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3168e4f5-26cb-43df-aacb-77bac708e0bb tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:42.978785 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-d21c9b2b-7397-429d-aeaa-b1128972a5ed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Action: 'create', calling method: .version_select at 0x7ffba00d08b0>, body: {"keypair": {"name": "tempest-keypair-182077312", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNKed0gUNPHlzFyjUngSQgkquDvnF4rS4GFhJXGvMrb/4BZnXr+e3RPSqnOvmAIJHZRQfJBoA7OARGTBQ1Ywtyi34CWKaXNjMU6MsHKlHKqZ3zI9ZJJ2lXN7V2vioTyoUQ=="}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:43.006123 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-d21c9b2b-7397-429d-aeaa-b1128972a5ed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Getting quotas for project 06061d6914ac4b86841d45162ceeb89f. Resources: {'key_pairs'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:10:43.014828 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-d21c9b2b-7397-429d-aeaa-b1128972a5ed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Getting quotas for user 4a1a40ef55434cd48a2dc4385880fe0b and project 06061d6914ac4b86841d45162ceeb89f. Resources: {'key_pairs'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:10:43.136054 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-3168e4f5-26cb-43df-aacb-77bac708e0bb tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:43.151187 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-3168e4f5-26cb-43df-aacb-77bac708e0bb tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1210 microversion: 2.1 time: 0.679366 Aug 02 09:10:43.152706 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 18/27] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:42 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1210 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:10:43.242680 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-d21c9b2b-7397-429d-aeaa-b1128972a5ed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.469212 Aug 02 09:10:43.242680 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 10/28] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Aug 2 09:10:41 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1471 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 02 09:10:44.175865 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b7c906b5-77c8-4f3a-95e7-beb07f7410b8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:44.177944 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b7c906b5-77c8-4f3a-95e7-beb07f7410b8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:44.219433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b7c906b5-77c8-4f3a-95e7-beb07f7410b8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:44.225682 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b7c906b5-77c8-4f3a-95e7-beb07f7410b8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:44.227147 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b7c906b5-77c8-4f3a-95e7-beb07f7410b8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:44.231274 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b7c906b5-77c8-4f3a-95e7-beb07f7410b8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:44.620622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-559a51e7-d977-4a41-99c2-a460042c2aec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-103817528", "imageRef": "7a52f4c5-c531-494a-b375-4f6dce3abbc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:44.678343 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=2 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:44.841472 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.network.neutron [None req-559a51e7-d977-4a41-99c2-a460042c2aec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] validate_networks() for [('279b0e6d-910d-4002-a8c0-bb7f28f694b8', None, None, None, None, None)] {{(pid=118525) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:10:44.994695 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b7c906b5-77c8-4f3a-95e7-beb07f7410b8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:45.017729 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b7c906b5-77c8-4f3a-95e7-beb07f7410b8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1266 microversion: 2.1 time: 0.846069 Aug 02 09:10:45.022420 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 11/29] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:44 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1266 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:45.179775 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-73ee5603-7a12-4128-8c4d-b32e9f6dbbf3 tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] Action: 'create', calling method: .version_select at 0x7ffb9affd670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2009816489", "metadata": {"Type": "work"}}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:45.204034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-73ee5603-7a12-4128-8c4d-b32e9f6dbbf3 tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] Request method failure captured: Aug 02 09:10:45.204034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 09:10:45.204034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:10:45.204034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:10:45.204034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:10:45.204034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 122 Aug 02 09:10:45.204034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:10:45.204034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:10:45.204034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:10:45.204034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:10:45.204034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OoTGwdvZ-UP_NdqcH_Q_I4VxKv1LaMBhj0MwDSPRM75gznnVmxXeFN3DYKL6tbdaq36YHoyFudPVc9obbNHKOeP9xEVOfQu94uNTuivN-mmAdkvjrlPFTNSPG79Q7JaH2Bd7D8kx3fnfmD1EJHEntXAXet_Ytkl_sJbS5B4k1Y1KmU Aug 02 09:10:45.204034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:10:45.204034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:10:45.204034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:10:45.204034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:10:45.204034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:10:45.204034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:10:45.204034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: c0dc48dd9e3f4cf0a93c4f91d52d4cda Aug 02 09:10:45.204034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-VolumesNegativeTest-977386620 Aug 02 09:10:45.204034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:10:45.204034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:10:45.205641 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c0dc48dd9e3f4cf0a93c4f91d52d4cda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c0dc48dd9e3f4cf0a93c4f91d52d4cda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c0dc48dd9e3f4cf0a93c4f91d52d4cda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c0dc48dd9e3f4cf0a93c4f91d52d4cda"}]}] Aug 02 09:10:45.205641 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-VolumesNegativeTest-977386620 Aug 02 09:10:45.205641 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: c0dc48dd9e3f4cf0a93c4f91d52d4cda Aug 02 09:10:45.205641 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-VolumesNegativeTest-977386620 Aug 02 09:10:45.205641 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-VolumesNegativeTest-977386620-project Aug 02 09:10:45.205641 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:10:45.205641 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:10:45.205641 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: 4ee442e6640c4e6a8f5426d6ab613783 Aug 02 09:10:45.205641 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-VolumesNegativeTest-977386620-project Aug 02 09:10:45.205641 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Aug 02 09:10:45.205641 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2009816489", "metadata": {"Type": "work"}}} Aug 02 09:10:45.205641 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: Aug 02 09:10:45.205641 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 09:10:45.206566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2009816489', 'metadata': {'Type': 'work'}}}} Aug 02 09:10:45.206566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:10:45.206566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:45.206566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 09:10:45.206566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 09:10:45.206566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 09:10:45.206566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise error Aug 02 09:10:45.206566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 02 09:10:45.206566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.206566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 02 09:10:45.206566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 09:10:45.206566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.206566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 09:10:45.206566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi '#$%' Aug 02 09:10:45.206566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.206566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:45.206566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.206566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:45.206566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:45.206566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:45.206566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:10:45.206566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:10:45.207868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:10:45.207868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:10:45.207868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:10:45.207868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:10:45.207868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 09:10:45.207868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 09:10:45.207868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 09:10:45.207868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 09:10:45.207868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 09:10:45.207868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 09:10:45.207868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 09:10:45.207868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.207868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:45.207868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.207868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:45.207868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:45.207868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:45.207868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 09:10:45.207868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 09:10:45.209732 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 02 09:10:45.209732 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.209732 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-73ee5603-7a12-4128-8c4d-b32e9f6dbbf3 tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:10:45.214298 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-73ee5603-7a12-4128-8c4d-b32e9f6dbbf3 tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.186850 Aug 02 09:10:45.217362 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 12/30] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Aug 2 09:10:45 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 189 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:10:45.242035 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-2369ebc9-5125-468a-b056-6d905b2ea080 tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] Action: 'create', calling method: .version_select at 0x7ffb9afb3e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-265735413", "metadata": {"Type": "work"}}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:45.249725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-2369ebc9-5125-468a-b056-6d905b2ea080 tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] Request method failure captured: Aug 02 09:10:45.249725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 09:10:45.249725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:10:45.249725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:10:45.249725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:10:45.249725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 119 Aug 02 09:10:45.249725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:10:45.249725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:10:45.249725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:10:45.249725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:10:45.249725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OoTGwdvZ-UP_NdqcH_Q_I4VxKv1LaMBhj0MwDSPRM75gznnVmxXeFN3DYKL6tbdaq36YHoyFudPVc9obbNHKOeP9xEVOfQu94uNTuivN-mmAdkvjrlPFTNSPG79Q7JaH2Bd7D8kx3fnfmD1EJHEntXAXet_Ytkl_sJbS5B4k1Y1KmU Aug 02 09:10:45.249725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:10:45.249725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:10:45.249725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:10:45.249725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:10:45.249725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:10:45.249725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:10:45.249725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: c0dc48dd9e3f4cf0a93c4f91d52d4cda Aug 02 09:10:45.249725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-VolumesNegativeTest-977386620 Aug 02 09:10:45.249725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:10:45.249725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:10:45.253489 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c0dc48dd9e3f4cf0a93c4f91d52d4cda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c0dc48dd9e3f4cf0a93c4f91d52d4cda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c0dc48dd9e3f4cf0a93c4f91d52d4cda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c0dc48dd9e3f4cf0a93c4f91d52d4cda"}]}] Aug 02 09:10:45.253489 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-VolumesNegativeTest-977386620 Aug 02 09:10:45.253489 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: c0dc48dd9e3f4cf0a93c4f91d52d4cda Aug 02 09:10:45.253489 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-VolumesNegativeTest-977386620 Aug 02 09:10:45.253489 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-VolumesNegativeTest-977386620-project Aug 02 09:10:45.253489 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:10:45.253489 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:10:45.253489 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: 4ee442e6640c4e6a8f5426d6ab613783 Aug 02 09:10:45.253489 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-VolumesNegativeTest-977386620-project Aug 02 09:10:45.253489 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Aug 02 09:10:45.253489 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-265735413", "metadata": {"Type": "work"}}} Aug 02 09:10:45.253489 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: Aug 02 09:10:45.253489 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 09:10:45.254134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-265735413', 'metadata': {'Type': 'work'}}}} Aug 02 09:10:45.254134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:10:45.254134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:45.254134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 09:10:45.254134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 09:10:45.254134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 09:10:45.254134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise error Aug 02 09:10:45.254134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 02 09:10:45.254134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.254134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 02 09:10:45.254134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 09:10:45.254134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.254134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 09:10:45.254134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi '0' Aug 02 09:10:45.254134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.254134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:45.254134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.254134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:45.254134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:45.254134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:45.254134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:10:45.254134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:10:45.256120 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:10:45.256120 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:10:45.256120 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:10:45.256120 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:10:45.256120 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 09:10:45.256120 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 09:10:45.256120 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 09:10:45.256120 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 09:10:45.256120 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 09:10:45.256120 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 09:10:45.256120 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 09:10:45.256120 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.256120 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:45.256120 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.256120 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:45.256120 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:45.256120 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:45.256120 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 09:10:45.256120 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 09:10:45.258122 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 02 09:10:45.258122 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.258122 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-2369ebc9-5125-468a-b056-6d905b2ea080 tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:10:45.258122 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-2369ebc9-5125-468a-b056-6d905b2ea080 tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.029435 Aug 02 09:10:45.265198 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 13/31] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Aug 2 09:10:45 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 44 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:10:45.298798 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-627e78a2-586a-4720-b54b-9e4ead22c555 tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] Action: 'create', calling method: .version_select at 0x7ffb9af87820>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-89013288", "metadata": {"Type": "work"}}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:45.306763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-627e78a2-586a-4720-b54b-9e4ead22c555 tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] Request method failure captured: Aug 02 09:10:45.306763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 02 09:10:45.306763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:10:45.306763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:10:45.306763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:10:45.306763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 117 Aug 02 09:10:45.306763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:10:45.306763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:10:45.306763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:10:45.306763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:10:45.306763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OoTGwdvZ-UP_NdqcH_Q_I4VxKv1LaMBhj0MwDSPRM75gznnVmxXeFN3DYKL6tbdaq36YHoyFudPVc9obbNHKOeP9xEVOfQu94uNTuivN-mmAdkvjrlPFTNSPG79Q7JaH2Bd7D8kx3fnfmD1EJHEntXAXet_Ytkl_sJbS5B4k1Y1KmU Aug 02 09:10:45.306763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:10:45.306763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:10:45.306763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:10:45.306763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:10:45.306763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:10:45.306763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:10:45.306763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: c0dc48dd9e3f4cf0a93c4f91d52d4cda Aug 02 09:10:45.306763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-VolumesNegativeTest-977386620 Aug 02 09:10:45.306763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:10:45.306763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:10:45.309217 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c0dc48dd9e3f4cf0a93c4f91d52d4cda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c0dc48dd9e3f4cf0a93c4f91d52d4cda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c0dc48dd9e3f4cf0a93c4f91d52d4cda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c0dc48dd9e3f4cf0a93c4f91d52d4cda"}]}] Aug 02 09:10:45.309217 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-VolumesNegativeTest-977386620 Aug 02 09:10:45.309217 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: c0dc48dd9e3f4cf0a93c4f91d52d4cda Aug 02 09:10:45.309217 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-VolumesNegativeTest-977386620 Aug 02 09:10:45.309217 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-VolumesNegativeTest-977386620-project Aug 02 09:10:45.309217 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:10:45.309217 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:10:45.309217 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: 4ee442e6640c4e6a8f5426d6ab613783 Aug 02 09:10:45.309217 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-VolumesNegativeTest-977386620-project Aug 02 09:10:45.309217 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Aug 02 09:10:45.309217 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-89013288", "metadata": {"Type": "work"}}} Aug 02 09:10:45.309217 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: Aug 02 09:10:45.309217 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 09:10:45.310890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-89013288', 'metadata': {'Type': 'work'}}}} Aug 02 09:10:45.310890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:10:45.310890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:45.310890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 02 09:10:45.310890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 02 09:10:45.310890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 02 09:10:45.310890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise error Aug 02 09:10:45.310890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 02 09:10:45.310890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.310890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 02 09:10:45.310890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 02 09:10:45.310890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.310890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 02 09:10:45.310890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi '' Aug 02 09:10:45.310890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.310890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:45.310890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.310890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:45.310890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:45.310890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:45.310890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:10:45.310890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:10:45.313537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:10:45.313537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:10:45.313537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:10:45.313537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:10:45.313537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 02 09:10:45.313537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 02 09:10:45.313537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 02 09:10:45.313537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 02 09:10:45.313537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 02 09:10:45.313537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 02 09:10:45.313537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 09:10:45.313537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.313537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:45.313537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.313537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:45.313537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:45.313537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:45.313537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 02 09:10:45.313537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 02 09:10:45.320282 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 02 09:10:45.320282 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.320282 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-627e78a2-586a-4720-b54b-9e4ead22c555 tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:10:45.320282 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-627e78a2-586a-4720-b54b-9e4ead22c555 tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.053068 Aug 02 09:10:45.328663 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 14/32] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Aug 2 09:10:45 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 63 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:10:45.338913 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-e6e77331-f295-4a34-880f-9ac763bf2ff8 tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] Calling method '.version_select at 0x7ffb9aeffe50>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:45.471833 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-e6e77331-f295-4a34-880f-9ac763bf2ff8 tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] HTTP exception thrown: Volume tempest-invalid-1775486278 could not be found. Aug 02 09:10:45.486003 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-e6e77331-f295-4a34-880f-9ac763bf2ff8 tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] Request method failure captured: Aug 02 09:10:45.486003 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1775486278 HTTP/1.1 Aug 02 09:10:45.486003 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:10:45.486003 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:10:45.486003 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:10:45.486003 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:10:45.486003 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:10:45.486003 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:10:45.486003 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:10:45.486003 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:10:45.486003 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OoTGwdvZ-UP_NdqcH_Q_I4VxKv1LaMBhj0MwDSPRM75gznnVmxXeFN3DYKL6tbdaq36YHoyFudPVc9obbNHKOeP9xEVOfQu94uNTuivN-mmAdkvjrlPFTNSPG79Q7JaH2Bd7D8kx3fnfmD1EJHEntXAXet_Ytkl_sJbS5B4k1Y1KmU Aug 02 09:10:45.486003 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:10:45.486003 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:10:45.486003 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:10:45.486003 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:10:45.486003 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:10:45.486003 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:10:45.486003 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: c0dc48dd9e3f4cf0a93c4f91d52d4cda Aug 02 09:10:45.486003 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-VolumesNegativeTest-977386620 Aug 02 09:10:45.486003 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:10:45.486003 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:10:45.488427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c0dc48dd9e3f4cf0a93c4f91d52d4cda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c0dc48dd9e3f4cf0a93c4f91d52d4cda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c0dc48dd9e3f4cf0a93c4f91d52d4cda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c0dc48dd9e3f4cf0a93c4f91d52d4cda"}]}] Aug 02 09:10:45.488427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-VolumesNegativeTest-977386620 Aug 02 09:10:45.488427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: c0dc48dd9e3f4cf0a93c4f91d52d4cda Aug 02 09:10:45.488427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-VolumesNegativeTest-977386620 Aug 02 09:10:45.488427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-VolumesNegativeTest-977386620-project Aug 02 09:10:45.488427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:10:45.488427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:10:45.488427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: 4ee442e6640c4e6a8f5426d6ab613783 Aug 02 09:10:45.488427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-VolumesNegativeTest-977386620-project Aug 02 09:10:45.488427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: Aug 02 09:10:45.488427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Volume tempest-invalid-1775486278 could not be found. Aug 02 09:10:45.488427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'id': 'tempest-invalid-1775486278'} Aug 02 09:10:45.488427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:10:45.490710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:45.490710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:10:45.490710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:10:45.490710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 09:10:45.490710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 09:10:45.490710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 09:10:45.490710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 09:10:45.490710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 09:10:45.490710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 09:10:45.490710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 09:10:45.490710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 09:10:45.490710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:10:45.490710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:10:45.490710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:10:45.490710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:10:45.490710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1775486278 could not be found. (HTTP 404) (Request-ID: req-fab281d1-2ced-4301-9433-0db82fc58e10) Aug 02 09:10:45.490710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.490710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:45.490710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.493927 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:45.493927 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 09:10:45.493927 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 09:10:45.493927 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:10:45.493927 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:10:45.493927 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 09:10:45.493927 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 09:10:45.493927 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:10:45.493927 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:10:45.493927 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:10:45.493927 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:10:45.493927 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 09:10:45.493927 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 09:10:45.493927 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 09:10:45.493927 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 09:10:45.493927 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 09:10:45.493927 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 09:10:45.493927 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 09:10:45.493927 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 09:10:45.497011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:10:45.497011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:10:45.497011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:10:45.497011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:10:45.497011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1775486278 could not be found. Aug 02 09:10:45.497011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.497011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:45.497011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.497011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:45.497011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:45.497011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:45.497011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:10:45.497011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:10:45.497011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:10:45.497011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:10:45.497011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:10:45.497011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:10:45.497011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 09:10:45.497011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:10:45.497011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1775486278 could not be found. Aug 02 09:10:45.503465 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.503465 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:45.503465 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.503465 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:45.503465 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:45.503465 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:45.503465 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:10:45.503465 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:10:45.503465 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1775486278 could not be found. Aug 02 09:10:45.503465 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:45.513713 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-e6e77331-f295-4a34-880f-9ac763bf2ff8 tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] Returning 404 to user: Volume tempest-invalid-1775486278 could not be found. {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:10:45.517098 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-e6e77331-f295-4a34-880f-9ac763bf2ff8 tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1775486278" status: 404 len: 99 microversion: 2.1 time: 0.185885 Aug 02 09:10:45.530705 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 15/33] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Aug 2 09:10:45 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1775486278 => generated 99 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 02 09:10:45.541626 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-3246ffe6-bb56-48a8-9e07-40b22526a4ab tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008842 Aug 02 09:10:45.552688 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 16/34] 10.222.0.20 () {58 vars in 1140 bytes} [Tue Aug 2 09:10:45 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 17 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 02 09:10:45.564659 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-cb34aee5-7646-4e4f-9834-db78f671fc17 tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.009882 Aug 02 09:10:45.575553 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 17/35] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Aug 2 09:10:45 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 14 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 02 09:10:45.590720 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-e7532c85-f137-426c-be4d-ac1fcf19bf23 tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] Calling method '.version_select at 0x7ffb9aed4040>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:47.396557 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-e7532c85-f137-426c-be4d-ac1fcf19bf23 tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] HTTP exception thrown: Volume 4368312e-f23c-4a80-bd32-dd52d4d7b87d could not be found. Aug 02 09:10:47.406481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-e7532c85-f137-426c-be4d-ac1fcf19bf23 tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] Request method failure captured: Aug 02 09:10:47.406481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: DELETE /compute/v2.1/os-volumes/4368312e-f23c-4a80-bd32-dd52d4d7b87d HTTP/1.1 Aug 02 09:10:47.406481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:10:47.406481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:10:47.406481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:10:47.406481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:10:47.406481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:10:47.406481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:10:47.406481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:10:47.406481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:10:47.406481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OoTGwdvZ-UP_NdqcH_Q_I4VxKv1LaMBhj0MwDSPRM75gznnVmxXeFN3DYKL6tbdaq36YHoyFudPVc9obbNHKOeP9xEVOfQu94uNTuivN-mmAdkvjrlPFTNSPG79Q7JaH2Bd7D8kx3fnfmD1EJHEntXAXet_Ytkl_sJbS5B4k1Y1KmU Aug 02 09:10:47.406481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:10:47.406481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:10:47.406481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:10:47.406481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:10:47.406481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:10:47.406481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:10:47.406481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: c0dc48dd9e3f4cf0a93c4f91d52d4cda Aug 02 09:10:47.406481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-VolumesNegativeTest-977386620 Aug 02 09:10:47.406481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:10:47.406481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:10:47.409842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c0dc48dd9e3f4cf0a93c4f91d52d4cda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c0dc48dd9e3f4cf0a93c4f91d52d4cda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c0dc48dd9e3f4cf0a93c4f91d52d4cda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c0dc48dd9e3f4cf0a93c4f91d52d4cda"}]}] Aug 02 09:10:47.409842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-VolumesNegativeTest-977386620 Aug 02 09:10:47.409842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: c0dc48dd9e3f4cf0a93c4f91d52d4cda Aug 02 09:10:47.409842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-VolumesNegativeTest-977386620 Aug 02 09:10:47.409842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-VolumesNegativeTest-977386620-project Aug 02 09:10:47.409842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:10:47.409842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:10:47.409842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: 4ee442e6640c4e6a8f5426d6ab613783 Aug 02 09:10:47.409842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-VolumesNegativeTest-977386620-project Aug 02 09:10:47.409842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: Aug 02 09:10:47.409842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Volume 4368312e-f23c-4a80-bd32-dd52d4d7b87d could not be found. Aug 02 09:10:47.409842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'id': '4368312e-f23c-4a80-bd32-dd52d4d7b87d'} Aug 02 09:10:47.409842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:10:47.411219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:47.411219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:10:47.411219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:10:47.411219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 09:10:47.411219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 09:10:47.411219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 09:10:47.411219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 09:10:47.411219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 09:10:47.411219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 09:10:47.411219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 09:10:47.411219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 09:10:47.411219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:10:47.411219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:10:47.411219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:10:47.411219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:10:47.411219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4368312e-f23c-4a80-bd32-dd52d4d7b87d could not be found. (HTTP 404) (Request-ID: req-43fd36fc-e0a9-4448-9e49-5e8f1a4d5f5e) Aug 02 09:10:47.411219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:47.411219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:47.411219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:47.414580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:47.414580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 02 09:10:47.414580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 02 09:10:47.414580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:10:47.414580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:10:47.414580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 09:10:47.414580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 09:10:47.414580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:10:47.414580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:10:47.414580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:10:47.414580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:10:47.414580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 02 09:10:47.414580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 02 09:10:47.414580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 02 09:10:47.414580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 02 09:10:47.414580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 02 09:10:47.414580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 02 09:10:47.414580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 02 09:10:47.414580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 02 09:10:47.416332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:10:47.416332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:10:47.416332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:10:47.416332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:10:47.416332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4368312e-f23c-4a80-bd32-dd52d4d7b87d could not be found. Aug 02 09:10:47.416332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:47.416332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:47.416332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:47.416332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:47.416332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:47.416332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:47.416332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:10:47.416332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:10:47.416332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:10:47.416332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:10:47.416332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:10:47.416332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:10:47.416332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 02 09:10:47.416332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:10:47.418142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4368312e-f23c-4a80-bd32-dd52d4d7b87d could not be found. Aug 02 09:10:47.418142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:47.418142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:47.418142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:47.418142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:47.418142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:47.418142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:47.418142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:10:47.418142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:10:47.418142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4368312e-f23c-4a80-bd32-dd52d4d7b87d could not be found. Aug 02 09:10:47.418142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:10:47.426430 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-e7532c85-f137-426c-be4d-ac1fcf19bf23 tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] Returning 404 to user: Volume 4368312e-f23c-4a80-bd32-dd52d4d7b87d could not be found. {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:10:47.434065 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-e7532c85-f137-426c-be4d-ac1fcf19bf23 tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/4368312e-f23c-4a80-bd32-dd52d4d7b87d" status: 404 len: 109 microversion: 2.1 time: 1.851289 Aug 02 09:10:47.437286 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 18/36] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 2 09:10:45 2022] DELETE /compute/v2.1/os-volumes/4368312e-f23c-4a80-bd32-dd52d4d7b87d => generated 109 bytes in 1860 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 09:10:47.474539 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-46408102-3080-4471-8f7c-460e230c5118 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:47.486755 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-46408102-3080-4471-8f7c-460e230c5118 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:47.528724 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-46408102-3080-4471-8f7c-460e230c5118 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:47.529508 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-46408102-3080-4471-8f7c-460e230c5118 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:47.530817 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-46408102-3080-4471-8f7c-460e230c5118 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:47.531607 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-46408102-3080-4471-8f7c-460e230c5118 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:48.189940 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-46408102-3080-4471-8f7c-460e230c5118 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:48.215481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-46408102-3080-4471-8f7c-460e230c5118 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1272 microversion: 2.1 time: 0.771729 Aug 02 09:10:48.217336 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 19/37] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:47 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1272 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:48.231311 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-0703badb-1d01-46d6-9563-432619308e09 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2028586282", "imageRef": "7a52f4c5-c531-494a-b375-4f6dce3abbc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51ed4955-009d-4088-8f3a-112c98fc8362"}], "security_groups": [{"name": "tempest-securitygroup--694748953"}], "key_name": "tempest-keypair-851894694", "user_data": "}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:48.264080 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-559a51e7-d977-4a41-99c2-a460042c2aec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Flavor limits 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:10:48.264884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-559a51e7-d977-4a41-99c2-a460042c2aec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Image limits 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:10:48.265012 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-559a51e7-d977-4a41-99c2-a460042c2aec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Flavor pref 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:10:48.265432 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-559a51e7-d977-4a41-99c2-a460042c2aec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Image pref 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:10:48.265880 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-559a51e7-d977-4a41-99c2-a460042c2aec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:10:48.295107 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-559a51e7-d977-4a41-99c2-a460042c2aec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:48.301571 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-559a51e7-d977-4a41-99c2-a460042c2aec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:48.301571 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-559a51e7-d977-4a41-99c2-a460042c2aec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:48.303230 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-559a51e7-d977-4a41-99c2-a460042c2aec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:48.464907 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-559a51e7-d977-4a41-99c2-a460042c2aec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Getting quotas for project 5b01727cea94442bb62b56e7a4ae57a0. Resources: {'cores', 'ram', 'instances'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:10:48.485002 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-559a51e7-d977-4a41-99c2-a460042c2aec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Getting quotas for user 1eda94767d1547fa82f6407a4c7de1d8 and project 5b01727cea94442bb62b56e7a4ae57a0. Resources: {'cores', 'ram', 'instances'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:10:48.546994 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-559a51e7-d977-4a41-99c2-a460042c2aec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Going to run 1 instances... {{(pid=118525) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:10:48.562277 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-559a51e7-d977-4a41-99c2-a460042c2aec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7a52f4c5-c531-494a-b375-4f6dce3abbc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118525) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:10:49.006947 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.network.neutron [None req-0703badb-1d01-46d6-9563-432619308e09 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] validate_networks() for [('51ed4955-009d-4088-8f3a-112c98fc8362', None, None, None, None, None)] {{(pid=118526) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:10:49.042344 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-559a51e7-d977-4a41-99c2-a460042c2aec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.887863 Aug 02 09:10:49.050521 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 19/38] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 2 09:10:43 2022] POST /compute/v2.1/servers => generated 383 bytes in 5890 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:10:49.061031 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-b757e1d3-8db5-49ac-af03-4b72ae7ec63f tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] Calling method '.version_select at 0x7ffb9bf0e940>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:49.156821 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-b757e1d3-8db5-49ac-af03-4b72ae7ec63f tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] HTTP exception thrown: Volume eb78b579-d2d9-40f0-a17c-fa35132508c7 could not be found. Aug 02 09:10:49.161049 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-b757e1d3-8db5-49ac-af03-4b72ae7ec63f tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] Request method failure captured: Aug 02 09:10:49.161049 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: GET /compute/v2.1/os-volumes/eb78b579-d2d9-40f0-a17c-fa35132508c7 HTTP/1.1 Aug 02 09:10:49.161049 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:10:49.161049 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:10:49.161049 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:10:49.161049 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:10:49.161049 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:10:49.161049 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:10:49.161049 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:10:49.161049 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:10:49.161049 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6OoTGwdvZ-UP_NdqcH_Q_I4VxKv1LaMBhj0MwDSPRM75gznnVmxXeFN3DYKL6tbdaq36YHoyFudPVc9obbNHKOeP9xEVOfQu94uNTuivN-mmAdkvjrlPFTNSPG79Q7JaH2Bd7D8kx3fnfmD1EJHEntXAXet_Ytkl_sJbS5B4k1Y1KmU Aug 02 09:10:49.161049 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:10:49.161049 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:10:49.161049 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:10:49.161049 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:10:49.161049 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:10:49.161049 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:10:49.161049 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: c0dc48dd9e3f4cf0a93c4f91d52d4cda Aug 02 09:10:49.161049 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-VolumesNegativeTest-977386620 Aug 02 09:10:49.161049 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:10:49.161049 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:10:49.165245 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c0dc48dd9e3f4cf0a93c4f91d52d4cda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/c0dc48dd9e3f4cf0a93c4f91d52d4cda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/c0dc48dd9e3f4cf0a93c4f91d52d4cda"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_c0dc48dd9e3f4cf0a93c4f91d52d4cda"}]}] Aug 02 09:10:49.165245 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-VolumesNegativeTest-977386620 Aug 02 09:10:49.165245 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: c0dc48dd9e3f4cf0a93c4f91d52d4cda Aug 02 09:10:49.165245 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-VolumesNegativeTest-977386620 Aug 02 09:10:49.165245 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-VolumesNegativeTest-977386620-project Aug 02 09:10:49.165245 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:10:49.165245 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:10:49.165245 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: 4ee442e6640c4e6a8f5426d6ab613783 Aug 02 09:10:49.165245 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-VolumesNegativeTest-977386620-project Aug 02 09:10:49.165245 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: Aug 02 09:10:49.165245 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Volume eb78b579-d2d9-40f0-a17c-fa35132508c7 could not be found. Aug 02 09:10:49.165245 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': 'eb78b579-d2d9-40f0-a17c-fa35132508c7'} Aug 02 09:10:49.165245 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:10:49.165968 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:49.165968 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:10:49.165968 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:10:49.165968 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:10:49.165968 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:10:49.165968 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:10:49.165968 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:10:49.165968 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:10:49.165968 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:10:49.165968 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:10:49.165968 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:10:49.165968 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:10:49.165968 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:10:49.165968 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:10:49.165968 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:10:49.165968 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb78b579-d2d9-40f0-a17c-fa35132508c7 could not be found. (HTTP 404) (Request-ID: req-32c2ab0b-6b57-44f3-b4f4-68a88e7c33d9) Aug 02 09:10:49.165968 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:49.165968 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:49.165968 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:49.167499 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:49.167499 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 09:10:49.167499 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 09:10:49.167499 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:10:49.167499 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:10:49.167499 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 09:10:49.167499 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 09:10:49.167499 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:10:49.167499 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:10:49.167499 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:10:49.167499 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:10:49.167499 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:10:49.167499 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:10:49.167499 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:10:49.167499 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:10:49.167499 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:10:49.167499 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:10:49.167499 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:10:49.167499 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:10:49.169077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:10:49.169077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:10:49.169077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:10:49.169077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:10:49.169077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb78b579-d2d9-40f0-a17c-fa35132508c7 could not be found. Aug 02 09:10:49.169077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:49.169077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:49.169077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:49.169077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:49.169077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:49.169077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:49.169077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:10:49.169077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:10:49.169077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:10:49.169077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:10:49.169077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:10:49.169077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:10:49.169077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 09:10:49.169077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:10:49.170117 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb78b579-d2d9-40f0-a17c-fa35132508c7 could not be found. Aug 02 09:10:49.170117 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:49.170117 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:10:49.170117 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:49.170117 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:10:49.170117 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:10:49.170117 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:10:49.170117 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:10:49.170117 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:10:49.170117 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb78b579-d2d9-40f0-a17c-fa35132508c7 could not be found. Aug 02 09:10:49.170117 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:10:49.170117 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-b757e1d3-8db5-49ac-af03-4b72ae7ec63f tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] Returning 404 to user: Volume eb78b579-d2d9-40f0-a17c-fa35132508c7 could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:10:49.175205 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-b757e1d3-8db5-49ac-af03-4b72ae7ec63f tempest-VolumesNegativeTest-977386620 tempest-VolumesNegativeTest-977386620-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/eb78b579-d2d9-40f0-a17c-fa35132508c7" status: 404 len: 109 microversion: 2.1 time: 0.119030 Aug 02 09:10:49.181632 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 20/39] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 2 09:10:49 2022] GET /compute/v2.1/os-volumes/eb78b579-d2d9-40f0-a17c-fa35132508c7 => generated 109 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:10:49.229407 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-e686bf55-8f8a-434f-84b7-c5cf4636921b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:49.232832 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-e686bf55-8f8a-434f-84b7-c5cf4636921b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:49.751621 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-e686bf55-8f8a-434f-84b7-c5cf4636921b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:49.790073 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-e686bf55-8f8a-434f-84b7-c5cf4636921b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1221 microversion: 2.1 time: 0.595635 Aug 02 09:10:49.797891 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 21/40] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:49 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1221 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:49.847950 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-1af184ac-b53f-4236-adc6-31825b55988a tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:49.847950 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-1af184ac-b53f-4236-adc6-31825b55988a tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:49.898598 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1af184ac-b53f-4236-adc6-31825b55988a tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:49.899267 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1af184ac-b53f-4236-adc6-31825b55988a tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:49.906505 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1af184ac-b53f-4236-adc6-31825b55988a tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:49.911993 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1af184ac-b53f-4236-adc6-31825b55988a tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:50.371213 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-1af184ac-b53f-4236-adc6-31825b55988a tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:50.396432 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-1af184ac-b53f-4236-adc6-31825b55988a tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1272 microversion: 2.1 time: 0.590785 Aug 02 09:10:50.402085 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 22/41] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:49 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1272 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:50.413056 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-6edf977d-9a22-4ceb-bdeb-d0aa639e25a2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-178764829", "imageRef": "7a52f4c5-c531-494a-b375-4f6dce3abbc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "07600d7a-420e-401f-8c47-198c159c9e44"}], "security_groups": [{"name": "tempest-securitygroup--1113655148"}], "key_name": "tempest-keypair-182077312", "user_data": "}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:50.987697 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.network.neutron [None req-6edf977d-9a22-4ceb-bdeb-d0aa639e25a2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] validate_networks() for [('07600d7a-420e-401f-8c47-198c159c9e44', None, None, None, None, None)] {{(pid=118525) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:10:53.027797 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=16 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:53.420763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-0703badb-1d01-46d6-9563-432619308e09 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Flavor limits 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:10:53.421755 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-0703badb-1d01-46d6-9563-432619308e09 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Image limits 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:10:53.422453 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-0703badb-1d01-46d6-9563-432619308e09 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Flavor pref 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:10:53.422988 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-0703badb-1d01-46d6-9563-432619308e09 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Image pref 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:10:53.423524 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-0703badb-1d01-46d6-9563-432619308e09 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:10:53.428958 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=4 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:10:53.458919 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0703badb-1d01-46d6-9563-432619308e09 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:53.458919 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0703badb-1d01-46d6-9563-432619308e09 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:53.458919 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0703badb-1d01-46d6-9563-432619308e09 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:53.458919 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0703badb-1d01-46d6-9563-432619308e09 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:53.542955 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-0703badb-1d01-46d6-9563-432619308e09 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Getting quotas for project b6fc6b07497a48eeb263b3a9b8aa7499. Resources: {'cores', 'ram', 'instances'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:10:53.560037 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-0703badb-1d01-46d6-9563-432619308e09 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Getting quotas for user ad3a9141e9284bb5a096fb04d3e9d581 and project b6fc6b07497a48eeb263b3a9b8aa7499. Resources: {'cores', 'ram', 'instances'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:10:53.609189 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-0703badb-1d01-46d6-9563-432619308e09 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Going to run 1 instances... {{(pid=118526) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:10:53.619704 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-0703badb-1d01-46d6-9563-432619308e09 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7a52f4c5-c531-494a-b375-4f6dce3abbc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:10:53.997656 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-0703badb-1d01-46d6-9563-432619308e09 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.777619 Aug 02 09:10:54.000697 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 20/42] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 2 09:10:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 5782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:10:54.027426 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-bf1a88cc-95aa-4279-b8b1-dfe42a088f0e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1912486582", "imageRef": "7a52f4c5-c531-494a-b375-4f6dce3abbc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:10:54.312183 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.network.neutron [None req-bf1a88cc-95aa-4279-b8b1-dfe42a088f0e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] validate_networks() for [('279b0e6d-910d-4002-a8c0-bb7f28f694b8', None, None, None, None, None)] {{(pid=118526) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:10:56.260615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-6edf977d-9a22-4ceb-bdeb-d0aa639e25a2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Flavor limits 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:10:56.266154 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-6edf977d-9a22-4ceb-bdeb-d0aa639e25a2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Image limits 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:10:56.266154 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-6edf977d-9a22-4ceb-bdeb-d0aa639e25a2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Flavor pref 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:10:56.266154 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-6edf977d-9a22-4ceb-bdeb-d0aa639e25a2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Image pref 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:10:56.266154 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-6edf977d-9a22-4ceb-bdeb-d0aa639e25a2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:10:56.341417 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6edf977d-9a22-4ceb-bdeb-d0aa639e25a2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:56.347501 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6edf977d-9a22-4ceb-bdeb-d0aa639e25a2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:56.351866 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6edf977d-9a22-4ceb-bdeb-d0aa639e25a2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:56.351866 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6edf977d-9a22-4ceb-bdeb-d0aa639e25a2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:56.547606 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-6edf977d-9a22-4ceb-bdeb-d0aa639e25a2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Getting quotas for project 06061d6914ac4b86841d45162ceeb89f. Resources: {'cores', 'ram', 'instances'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:10:56.574284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-6edf977d-9a22-4ceb-bdeb-d0aa639e25a2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Getting quotas for user 4a1a40ef55434cd48a2dc4385880fe0b and project 06061d6914ac4b86841d45162ceeb89f. Resources: {'cores', 'ram', 'instances'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:10:56.647700 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-6edf977d-9a22-4ceb-bdeb-d0aa639e25a2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Going to run 1 instances... {{(pid=118525) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:10:56.653121 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-6edf977d-9a22-4ceb-bdeb-d0aa639e25a2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7a52f4c5-c531-494a-b375-4f6dce3abbc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118525) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:10:56.987934 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-6edf977d-9a22-4ceb-bdeb-d0aa639e25a2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 6.578125 Aug 02 09:10:57.000271 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 23/43] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Aug 2 09:10:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 6590 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 02 09:10:57.042152 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-0588284b-ded6-4549-97da-36324f2449d7 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:57.043362 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-0588284b-ded6-4549-97da-36324f2449d7 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:57.107113 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0588284b-ded6-4549-97da-36324f2449d7 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:57.108474 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0588284b-ded6-4549-97da-36324f2449d7 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:57.118007 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0588284b-ded6-4549-97da-36324f2449d7 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:57.122663 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0588284b-ded6-4549-97da-36324f2449d7 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:57.506751 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-bf1a88cc-95aa-4279-b8b1-dfe42a088f0e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Flavor limits 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:10:57.507586 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-bf1a88cc-95aa-4279-b8b1-dfe42a088f0e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Image limits 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:10:57.507854 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-bf1a88cc-95aa-4279-b8b1-dfe42a088f0e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Flavor pref 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:10:57.508460 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-bf1a88cc-95aa-4279-b8b1-dfe42a088f0e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Image pref 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:10:57.509182 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-bf1a88cc-95aa-4279-b8b1-dfe42a088f0e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:10:57.533148 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bf1a88cc-95aa-4279-b8b1-dfe42a088f0e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:57.547745 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bf1a88cc-95aa-4279-b8b1-dfe42a088f0e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:57.547745 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bf1a88cc-95aa-4279-b8b1-dfe42a088f0e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:57.547745 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bf1a88cc-95aa-4279-b8b1-dfe42a088f0e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:57.597252 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-bf1a88cc-95aa-4279-b8b1-dfe42a088f0e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Getting quotas for project 5b01727cea94442bb62b56e7a4ae57a0. Resources: {'cores', 'ram', 'instances'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:10:57.641811 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-bf1a88cc-95aa-4279-b8b1-dfe42a088f0e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Getting quotas for user 1eda94767d1547fa82f6407a4c7de1d8 and project 5b01727cea94442bb62b56e7a4ae57a0. Resources: {'cores', 'ram', 'instances'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:10:57.691690 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-bf1a88cc-95aa-4279-b8b1-dfe42a088f0e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Going to run 1 instances... {{(pid=118526) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:10:57.705972 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-bf1a88cc-95aa-4279-b8b1-dfe42a088f0e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7a52f4c5-c531-494a-b375-4f6dce3abbc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:10:58.117016 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-bf1a88cc-95aa-4279-b8b1-dfe42a088f0e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.113955 Aug 02 09:10:58.134966 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 21/44] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 2 09:10:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 4133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:10:58.183552 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-4801c823-3f6c-430a-8b38-eba7475c9f4f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:58.185906 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-4801c823-3f6c-430a-8b38-eba7475c9f4f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:58.262461 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4801c823-3f6c-430a-8b38-eba7475c9f4f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:58.265753 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4801c823-3f6c-430a-8b38-eba7475c9f4f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:58.285198 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4801c823-3f6c-430a-8b38-eba7475c9f4f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:58.287723 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4801c823-3f6c-430a-8b38-eba7475c9f4f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:58.466466 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-0588284b-ded6-4549-97da-36324f2449d7 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:58.482983 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-0588284b-ded6-4549-97da-36324f2449d7 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1314 microversion: 2.1 time: 1.480551 Aug 02 09:10:58.500538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 24/45] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:56 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1314 bytes in 1503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:58.563755 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-91720e25-fde7-45af-a8ce-67007ecf9dd1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:58.571326 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-91720e25-fde7-45af-a8ce-67007ecf9dd1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:59.060259 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-91720e25-fde7-45af-a8ce-67007ecf9dd1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:59.072402 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-91720e25-fde7-45af-a8ce-67007ecf9dd1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:59.075072 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-91720e25-fde7-45af-a8ce-67007ecf9dd1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:59.077568 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-91720e25-fde7-45af-a8ce-67007ecf9dd1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1280 microversion: 2.20 time: 0.573112 Aug 02 09:10:59.085287 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-4801c823-3f6c-430a-8b38-eba7475c9f4f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:59.100646 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 25/46] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:10:58 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1280 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:10:59.120753 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-4801c823-3f6c-430a-8b38-eba7475c9f4f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1293 microversion: 2.1 time: 0.981476 Aug 02 09:10:59.140536 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 22/47] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:58 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1293 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:59.140789 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-7961bff5-f6a0-432e-966f-cbdb52477622 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:59.144447 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-7961bff5-f6a0-432e-966f-cbdb52477622 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:59.457561 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-7961bff5-f6a0-432e-966f-cbdb52477622 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:10:59.510439 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b7370d15-488a-496a-b408-70b223b87efa tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:10:59.511494 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b7370d15-488a-496a-b408-70b223b87efa tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:10:59.515326 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-7961bff5-f6a0-432e-966f-cbdb52477622 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1222 microversion: 2.1 time: 0.380204 Aug 02 09:10:59.522367 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 26/48] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:59 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1222 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:10:59.534571 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b7370d15-488a-496a-b408-70b223b87efa tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:59.534571 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b7370d15-488a-496a-b408-70b223b87efa tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:10:59.534571 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b7370d15-488a-496a-b408-70b223b87efa tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:10:59.534571 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b7370d15-488a-496a-b408-70b223b87efa tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:00.120069 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-24fcb73a-a521-477c-b7ab-3bfc4a1aaaff tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:00.121112 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-24fcb73a-a521-477c-b7ab-3bfc4a1aaaff tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:00.136222 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-24fcb73a-a521-477c-b7ab-3bfc4a1aaaff tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:00.138193 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-24fcb73a-a521-477c-b7ab-3bfc4a1aaaff tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:00.140627 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-24fcb73a-a521-477c-b7ab-3bfc4a1aaaff tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:00.141760 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-24fcb73a-a521-477c-b7ab-3bfc4a1aaaff tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:00.439585 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-24fcb73a-a521-477c-b7ab-3bfc4a1aaaff tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:00.453912 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-24fcb73a-a521-477c-b7ab-3bfc4a1aaaff tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:00.455798 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-24fcb73a-a521-477c-b7ab-3bfc4a1aaaff tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:00.465106 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-24fcb73a-a521-477c-b7ab-3bfc4a1aaaff tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1284 microversion: 2.20 time: 0.353364 Aug 02 09:11:00.470880 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 27/49] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:00 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1284 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:00.483382 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-8c91b4bb-7cba-4336-b2d7-445bb3e1a730 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:00.491701 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-8c91b4bb-7cba-4336-b2d7-445bb3e1a730 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:00.514243 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8c91b4bb-7cba-4336-b2d7-445bb3e1a730 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:00.521440 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8c91b4bb-7cba-4336-b2d7-445bb3e1a730 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:00.534415 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8c91b4bb-7cba-4336-b2d7-445bb3e1a730 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:00.534951 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8c91b4bb-7cba-4336-b2d7-445bb3e1a730 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:00.879274 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-8c91b4bb-7cba-4336-b2d7-445bb3e1a730 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:00.907029 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-8c91b4bb-7cba-4336-b2d7-445bb3e1a730 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1299 microversion: 2.1 time: 0.433892 Aug 02 09:11:00.908586 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 28/50] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:00 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1299 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:00.932689 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-63573017-706d-49ae-87bf-4780fc415ded tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:00.940671 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-63573017-706d-49ae-87bf-4780fc415ded tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:00.968412 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-63573017-706d-49ae-87bf-4780fc415ded tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:00.970615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-63573017-706d-49ae-87bf-4780fc415ded tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:00.971500 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-63573017-706d-49ae-87bf-4780fc415ded tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:00.976734 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-63573017-706d-49ae-87bf-4780fc415ded tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:01.490931 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-63573017-706d-49ae-87bf-4780fc415ded tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:01.510479 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-63573017-706d-49ae-87bf-4780fc415ded tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1226 microversion: 2.1 time: 0.600245 Aug 02 09:11:01.511106 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 29/51] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:00 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1226 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:01.543718 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b7370d15-488a-496a-b408-70b223b87efa tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:01.559374 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b7370d15-488a-496a-b408-70b223b87efa tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1314 microversion: 2.1 time: 2.056170 Aug 02 09:11:01.563572 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 23/52] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:10:59 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1314 bytes in 2062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:01.570252 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-fb50b8e1-7eb8-446d-834c-17b5c38f92af tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:01.571384 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-fb50b8e1-7eb8-446d-834c-17b5c38f92af tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:01.587443 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fb50b8e1-7eb8-446d-834c-17b5c38f92af tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:01.599777 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fb50b8e1-7eb8-446d-834c-17b5c38f92af tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:01.603095 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fb50b8e1-7eb8-446d-834c-17b5c38f92af tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:01.604718 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fb50b8e1-7eb8-446d-834c-17b5c38f92af tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:01.799748 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-3f535251-0512-471f-b3de-cf2eb398e5bc req-dc877fb2-5ae6-4a88-a998-b7be832cf465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b99c5502-ef55-4e1e-a47c-c708aaf2b0ff", "tag": "16c5e6c0-6e16-42f7-ae1b-1356afbca34d"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:01.827960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-fb50b8e1-7eb8-446d-834c-17b5c38f92af tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:01.842903 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-fb50b8e1-7eb8-446d-834c-17b5c38f92af tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:01.858642 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-fb50b8e1-7eb8-446d-834c-17b5c38f92af tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:01.867040 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-fb50b8e1-7eb8-446d-834c-17b5c38f92af tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1332 microversion: 2.20 time: 0.301495 Aug 02 09:11:01.871441 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 24/53] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:01 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1332 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:01.892073 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-3f535251-0512-471f-b3de-cf2eb398e5bc req-dc877fb2-5ae6-4a88-a998-b7be832cf465 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:01.893458 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-3f535251-0512-471f-b3de-cf2eb398e5bc req-dc877fb2-5ae6-4a88-a998-b7be832cf465 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:01.953923 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-fe4db888-80a8-47c5-85f8-d1d651129d5e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:01.955212 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-fe4db888-80a8-47c5-85f8-d1d651129d5e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:01.986152 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fe4db888-80a8-47c5-85f8-d1d651129d5e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:01.987038 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fe4db888-80a8-47c5-85f8-d1d651129d5e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:01.997621 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fe4db888-80a8-47c5-85f8-d1d651129d5e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:02.001138 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fe4db888-80a8-47c5-85f8-d1d651129d5e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:02.016847 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-3f535251-0512-471f-b3de-cf2eb398e5bc req-dc877fb2-5ae6-4a88-a998-b7be832cf465 service nova] Creating event network-changed:16c5e6c0-6e16-42f7-ae1b-1356afbca34d for instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff on hv-cinder-84599 Aug 02 09:11:02.017829 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-3f535251-0512-471f-b3de-cf2eb398e5bc req-dc877fb2-5ae6-4a88-a998-b7be832cf465 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118525) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 09:11:02.027061 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a3f4e60b-8d18-4ac7-8b2d-a0c134b2562f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:02.027937 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a3f4e60b-8d18-4ac7-8b2d-a0c134b2562f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:02.029002 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a3f4e60b-8d18-4ac7-8b2d-a0c134b2562f None None] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:02.038039 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a3f4e60b-8d18-4ac7-8b2d-a0c134b2562f None None] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:02.071705 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.compute.rpcapi [None req-a3f4e60b-8d18-4ac7-8b2d-a0c134b2562f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 02 09:11:02.072557 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a3f4e60b-8d18-4ac7-8b2d-a0c134b2562f None None] Releasing lock "compute-rpcapi-router" {{(pid=118525) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 09:11:02.179639 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-a3f4e60b-8d18-4ac7-8b2d-a0c134b2562f None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.667124 Aug 02 09:11:02.181144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 30/54] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:02.256756 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-fe4db888-80a8-47c5-85f8-d1d651129d5e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:02.269199 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-fe4db888-80a8-47c5-85f8-d1d651129d5e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1299 microversion: 2.1 time: 0.341979 Aug 02 09:11:02.281433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 25/55] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:01 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1299 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:02.541753 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-8f5c6a4f-d52a-4346-8ef1-4bc1d750ad0a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:02.546282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-8f5c6a4f-d52a-4346-8ef1-4bc1d750ad0a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:02.577497 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8f5c6a4f-d52a-4346-8ef1-4bc1d750ad0a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:02.578195 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8f5c6a4f-d52a-4346-8ef1-4bc1d750ad0a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:02.579134 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8f5c6a4f-d52a-4346-8ef1-4bc1d750ad0a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:02.579980 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8f5c6a4f-d52a-4346-8ef1-4bc1d750ad0a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:02.597107 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-11dbe2f1-62a3-424c-bae0-915d2befbcdd tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:02.612066 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-11dbe2f1-62a3-424c-bae0-915d2befbcdd tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:02.615456 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-11dbe2f1-62a3-424c-bae0-915d2befbcdd tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:02.617458 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-11dbe2f1-62a3-424c-bae0-915d2befbcdd tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:02.620472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-11dbe2f1-62a3-424c-bae0-915d2befbcdd tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:02.622461 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-11dbe2f1-62a3-424c-bae0-915d2befbcdd tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:02.698827 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=43 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:02.877967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-8f5c6a4f-d52a-4346-8ef1-4bc1d750ad0a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:02.908797 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-8f5c6a4f-d52a-4346-8ef1-4bc1d750ad0a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1274 microversion: 2.1 time: 0.362895 Aug 02 09:11:02.912317 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 31/56] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:02 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1274 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:02.928892 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-b4883516-0d1f-4368-a786-fd654e5e58d6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:02.931585 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-b4883516-0d1f-4368-a786-fd654e5e58d6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:02.962620 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b4883516-0d1f-4368-a786-fd654e5e58d6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:02.965312 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b4883516-0d1f-4368-a786-fd654e5e58d6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:02.971061 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b4883516-0d1f-4368-a786-fd654e5e58d6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:02.974530 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b4883516-0d1f-4368-a786-fd654e5e58d6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:03.193409 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-b4883516-0d1f-4368-a786-fd654e5e58d6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:03.217567 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-11dbe2f1-62a3-424c-bae0-915d2befbcdd tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:03.228057 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-b4883516-0d1f-4368-a786-fd654e5e58d6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:03.233441 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-11dbe2f1-62a3-424c-bae0-915d2befbcdd tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1314 microversion: 2.1 time: 0.644748 Aug 02 09:11:03.237166 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-b4883516-0d1f-4368-a786-fd654e5e58d6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:03.242378 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-b4883516-0d1f-4368-a786-fd654e5e58d6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1350 microversion: 2.20 time: 0.326481 Aug 02 09:11:03.243862 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 32/57] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:02 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1350 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:03.246049 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 26/58] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:02 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1314 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:03.297248 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-704e9224-f256-4614-87fe-45c377f50918 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:03.298223 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-704e9224-f256-4614-87fe-45c377f50918 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:03.314726 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-704e9224-f256-4614-87fe-45c377f50918 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:03.315234 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-704e9224-f256-4614-87fe-45c377f50918 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:03.316217 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-704e9224-f256-4614-87fe-45c377f50918 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:03.316850 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-704e9224-f256-4614-87fe-45c377f50918 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:03.481110 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-704e9224-f256-4614-87fe-45c377f50918 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:03.495761 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-704e9224-f256-4614-87fe-45c377f50918 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1299 microversion: 2.1 time: 0.203971 Aug 02 09:11:03.497285 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 33/59] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:03 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1299 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:03.952811 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-39505d0a-41be-4ebf-957f-9215c4ff3f41 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:03.954049 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-39505d0a-41be-4ebf-957f-9215c4ff3f41 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:03.973468 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-39505d0a-41be-4ebf-957f-9215c4ff3f41 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:03.975939 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-39505d0a-41be-4ebf-957f-9215c4ff3f41 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:03.977685 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-39505d0a-41be-4ebf-957f-9215c4ff3f41 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:03.980854 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-39505d0a-41be-4ebf-957f-9215c4ff3f41 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:04.302275 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-b67b19a6-994c-4acb-8b95-791f6f2548d1 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:04.303305 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-b67b19a6-994c-4acb-8b95-791f6f2548d1 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:04.361323 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:04.374557 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b67b19a6-994c-4acb-8b95-791f6f2548d1 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:04.382459 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b67b19a6-994c-4acb-8b95-791f6f2548d1 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:04.390338 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b67b19a6-994c-4acb-8b95-791f6f2548d1 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:04.390338 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b67b19a6-994c-4acb-8b95-791f6f2548d1 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:04.479929 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=63 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:04.937868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-39505d0a-41be-4ebf-957f-9215c4ff3f41 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:04.955914 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-39505d0a-41be-4ebf-957f-9215c4ff3f41 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1282 microversion: 2.1 time: 1.010012 Aug 02 09:11:04.979288 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 27/60] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:03 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1282 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:04.993800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-4ec63e19-ef78-458a-a32d-fb3763170fc5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:04.994481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-4ec63e19-ef78-458a-a32d-fb3763170fc5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:05.005650 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4ec63e19-ef78-458a-a32d-fb3763170fc5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:05.010170 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4ec63e19-ef78-458a-a32d-fb3763170fc5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:05.011167 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4ec63e19-ef78-458a-a32d-fb3763170fc5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:05.016766 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4ec63e19-ef78-458a-a32d-fb3763170fc5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:05.131735 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-b67b19a6-994c-4acb-8b95-791f6f2548d1 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:05.146267 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-b67b19a6-994c-4acb-8b95-791f6f2548d1 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1314 microversion: 2.1 time: 0.892184 Aug 02 09:11:05.151963 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 34/61] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:04 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1314 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:05.175436 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-7b1bc58f-5332-44af-8091-5ddf5962b79a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:05.176151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-7b1bc58f-5332-44af-8091-5ddf5962b79a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:05.183122 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-4ec63e19-ef78-458a-a32d-fb3763170fc5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:05.193189 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-4ec63e19-ef78-458a-a32d-fb3763170fc5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:05.193751 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7b1bc58f-5332-44af-8091-5ddf5962b79a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:05.194592 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7b1bc58f-5332-44af-8091-5ddf5962b79a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:05.194920 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-4ec63e19-ef78-458a-a32d-fb3763170fc5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:05.196062 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7b1bc58f-5332-44af-8091-5ddf5962b79a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:05.196529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7b1bc58f-5332-44af-8091-5ddf5962b79a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:05.199794 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-4ec63e19-ef78-458a-a32d-fb3763170fc5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1338 microversion: 2.20 time: 0.215612 Aug 02 09:11:05.200801 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 28/62] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:04 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1338 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:05.397209 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-7b1bc58f-5332-44af-8091-5ddf5962b79a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:05.414781 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-7b1bc58f-5332-44af-8091-5ddf5962b79a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1366 microversion: 2.1 time: 0.261032 Aug 02 09:11:05.417082 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 35/63] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:05 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:05.982666 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-79159af4-9a07-4d43-9137-86efca2f2534 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:05.983642 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-79159af4-9a07-4d43-9137-86efca2f2534 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:05.993375 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-79159af4-9a07-4d43-9137-86efca2f2534 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:05.994213 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-79159af4-9a07-4d43-9137-86efca2f2534 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:05.995180 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-79159af4-9a07-4d43-9137-86efca2f2534 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:05.995823 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-79159af4-9a07-4d43-9137-86efca2f2534 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:06.103719 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-79159af4-9a07-4d43-9137-86efca2f2534 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:06.124200 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-79159af4-9a07-4d43-9137-86efca2f2534 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1280 microversion: 2.1 time: 0.145757 Aug 02 09:11:06.125250 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 29/64] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:05 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1280 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:06.191534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-9469c569-568a-44fb-ab99-b445a179f335 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:06.192173 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-9469c569-568a-44fb-ab99-b445a179f335 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:06.206937 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9469c569-568a-44fb-ab99-b445a179f335 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:06.208275 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9469c569-568a-44fb-ab99-b445a179f335 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:06.209755 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9469c569-568a-44fb-ab99-b445a179f335 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:06.210321 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9469c569-568a-44fb-ab99-b445a179f335 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:06.243788 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-3ef0c196-c2a5-4295-ae47-18839d459e4d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:06.244566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-3ef0c196-c2a5-4295-ae47-18839d459e4d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:06.251678 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3ef0c196-c2a5-4295-ae47-18839d459e4d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:06.252242 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3ef0c196-c2a5-4295-ae47-18839d459e4d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:06.253288 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3ef0c196-c2a5-4295-ae47-18839d459e4d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:06.254033 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3ef0c196-c2a5-4295-ae47-18839d459e4d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:06.527480 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-9469c569-568a-44fb-ab99-b445a179f335 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:06.538750 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-9469c569-568a-44fb-ab99-b445a179f335 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1314 microversion: 2.1 time: 0.351884 Aug 02 09:11:06.539780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 36/65] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:06 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:06.551046 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-3ef0c196-c2a5-4295-ae47-18839d459e4d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:06.568473 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-3ef0c196-c2a5-4295-ae47-18839d459e4d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:06.570841 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-3ef0c196-c2a5-4295-ae47-18839d459e4d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:06.572052 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-3ef0c196-c2a5-4295-ae47-18839d459e4d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1406 microversion: 2.20 time: 0.332752 Aug 02 09:11:06.572651 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 30/66] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:06 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1406 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:06.587483 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-ada7e41c-23f1-47bd-a194-3c2f797ff844 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:06.588681 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-ada7e41c-23f1-47bd-a194-3c2f797ff844 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:06.599492 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ada7e41c-23f1-47bd-a194-3c2f797ff844 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:06.600315 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ada7e41c-23f1-47bd-a194-3c2f797ff844 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:06.601665 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ada7e41c-23f1-47bd-a194-3c2f797ff844 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:06.602460 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ada7e41c-23f1-47bd-a194-3c2f797ff844 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:06.642988 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-09f23858-4527-4b5d-98b7-600fcb4bbb9e req-c3e7edf9-6f3f-4fb8-8fc1-155a950b83ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44854eb9-caa3-4fc7-bd14-6a150fcafcd3", "tag": "da035960-2909-47c1-95e2-3f882cc28445"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:06.653802 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-09f23858-4527-4b5d-98b7-600fcb4bbb9e req-c3e7edf9-6f3f-4fb8-8fc1-155a950b83ec service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:06.654319 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-09f23858-4527-4b5d-98b7-600fcb4bbb9e req-c3e7edf9-6f3f-4fb8-8fc1-155a950b83ec service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:06.667943 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-09f23858-4527-4b5d-98b7-600fcb4bbb9e req-c3e7edf9-6f3f-4fb8-8fc1-155a950b83ec service nova] Creating event network-changed:da035960-2909-47c1-95e2-3f882cc28445 for instance 44854eb9-caa3-4fc7-bd14-6a150fcafcd3 on hv-cinder-84599 Aug 02 09:11:06.673232 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-09f23858-4527-4b5d-98b7-600fcb4bbb9e req-c3e7edf9-6f3f-4fb8-8fc1-155a950b83ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131666 Aug 02 09:11:06.673948 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 37/67] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:06.819559 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-ada7e41c-23f1-47bd-a194-3c2f797ff844 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:06.855325 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-ada7e41c-23f1-47bd-a194-3c2f797ff844 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1366 microversion: 2.1 time: 0.281168 Aug 02 09:11:06.857366 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 31/68] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:06 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:07.166112 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-a720f25f-0f51-4286-9427-db40a6f9d414 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:07.167165 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-a720f25f-0f51-4286-9427-db40a6f9d414 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:07.182261 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a720f25f-0f51-4286-9427-db40a6f9d414 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:07.182261 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a720f25f-0f51-4286-9427-db40a6f9d414 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:07.182261 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a720f25f-0f51-4286-9427-db40a6f9d414 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:07.182261 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a720f25f-0f51-4286-9427-db40a6f9d414 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:07.346395 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-a720f25f-0f51-4286-9427-db40a6f9d414 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:07.358646 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-a720f25f-0f51-4286-9427-db40a6f9d414 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1280 microversion: 2.1 time: 0.197419 Aug 02 09:11:07.374518 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 38/69] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:07 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1280 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:07.579235 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-52769af4-b98e-4293-8858-f09b225541b4 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:07.580457 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-52769af4-b98e-4293-8858-f09b225541b4 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:07.582380 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=4 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:07.591153 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-52769af4-b98e-4293-8858-f09b225541b4 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:07.591960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-52769af4-b98e-4293-8858-f09b225541b4 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:07.598018 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-52769af4-b98e-4293-8858-f09b225541b4 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:07.599480 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-52769af4-b98e-4293-8858-f09b225541b4 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:07.624529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-f1ddb122-d06f-4de2-946d-0b7ba48588c9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:07.625751 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-f1ddb122-d06f-4de2-946d-0b7ba48588c9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:07.661019 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f1ddb122-d06f-4de2-946d-0b7ba48588c9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:07.662339 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f1ddb122-d06f-4de2-946d-0b7ba48588c9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:07.663813 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f1ddb122-d06f-4de2-946d-0b7ba48588c9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:07.675137 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f1ddb122-d06f-4de2-946d-0b7ba48588c9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:07.688492 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=12 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:07.961650 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-52769af4-b98e-4293-8858-f09b225541b4 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:07.971354 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-52769af4-b98e-4293-8858-f09b225541b4 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1314 microversion: 2.1 time: 0.400118 Aug 02 09:11:07.978286 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 32/70] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:07 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1314 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:07.991452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-58d82f32-bc5e-470e-bad0-bbafd24c797c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:07.994234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-58d82f32-bc5e-470e-bad0-bbafd24c797c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:08.002143 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-58d82f32-bc5e-470e-bad0-bbafd24c797c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:08.002919 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-58d82f32-bc5e-470e-bad0-bbafd24c797c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:08.008223 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-58d82f32-bc5e-470e-bad0-bbafd24c797c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:08.008223 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-58d82f32-bc5e-470e-bad0-bbafd24c797c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:08.041638 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-f1ddb122-d06f-4de2-946d-0b7ba48588c9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:08.058669 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-f1ddb122-d06f-4de2-946d-0b7ba48588c9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:08.060400 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-f1ddb122-d06f-4de2-946d-0b7ba48588c9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:08.061769 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-f1ddb122-d06f-4de2-946d-0b7ba48588c9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1406 microversion: 2.20 time: 0.462908 Aug 02 09:11:08.063004 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 39/71] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:07 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1406 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:08.267655 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-58d82f32-bc5e-470e-bad0-bbafd24c797c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:08.297563 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-58d82f32-bc5e-470e-bad0-bbafd24c797c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1366 microversion: 2.1 time: 0.317792 Aug 02 09:11:08.300205 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 33/72] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:07 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1366 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:08.388287 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-64a4e347-0968-4be2-aeb0-d75f686c8fec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:08.389003 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-64a4e347-0968-4be2-aeb0-d75f686c8fec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:08.403116 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-64a4e347-0968-4be2-aeb0-d75f686c8fec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:08.404367 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-64a4e347-0968-4be2-aeb0-d75f686c8fec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:08.410204 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-64a4e347-0968-4be2-aeb0-d75f686c8fec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:08.411059 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-64a4e347-0968-4be2-aeb0-d75f686c8fec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:08.547182 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-64a4e347-0968-4be2-aeb0-d75f686c8fec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:08.557589 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-64a4e347-0968-4be2-aeb0-d75f686c8fec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1280 microversion: 2.1 time: 0.178379 Aug 02 09:11:08.559189 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 40/73] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:08 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1280 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:09.022058 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a1112f97-9995-425b-a76f-187573fcd01d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:09.023192 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-a1112f97-9995-425b-a76f-187573fcd01d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:09.035414 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a1112f97-9995-425b-a76f-187573fcd01d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:09.036403 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a1112f97-9995-425b-a76f-187573fcd01d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:09.037919 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a1112f97-9995-425b-a76f-187573fcd01d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:09.038819 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a1112f97-9995-425b-a76f-187573fcd01d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:09.108184 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-2ac6946e-1e22-4c04-8923-b564086cb44d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:09.110609 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-2ac6946e-1e22-4c04-8923-b564086cb44d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:09.125215 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2ac6946e-1e22-4c04-8923-b564086cb44d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:09.126431 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2ac6946e-1e22-4c04-8923-b564086cb44d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:09.128203 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2ac6946e-1e22-4c04-8923-b564086cb44d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:09.130483 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2ac6946e-1e22-4c04-8923-b564086cb44d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:09.373070 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-2ac6946e-1e22-4c04-8923-b564086cb44d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:09.374812 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-a1112f97-9995-425b-a76f-187573fcd01d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:09.388537 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-2ac6946e-1e22-4c04-8923-b564086cb44d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:09.388914 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-a1112f97-9995-425b-a76f-187573fcd01d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1314 microversion: 2.1 time: 0.375823 Aug 02 09:11:09.389645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 34/74] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:09 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:09.391753 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-2ac6946e-1e22-4c04-8923-b564086cb44d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:09.394194 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-2ac6946e-1e22-4c04-8923-b564086cb44d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1406 microversion: 2.20 time: 0.294125 Aug 02 09:11:09.395226 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 41/75] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:09 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1406 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:11:09.397128 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-5d3f91a7-c00c-4136-bee6-4e7ca9f61ef3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:09.398466 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-5d3f91a7-c00c-4136-bee6-4e7ca9f61ef3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:09.410807 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5d3f91a7-c00c-4136-bee6-4e7ca9f61ef3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:09.411816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5d3f91a7-c00c-4136-bee6-4e7ca9f61ef3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:09.413338 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5d3f91a7-c00c-4136-bee6-4e7ca9f61ef3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:09.414126 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5d3f91a7-c00c-4136-bee6-4e7ca9f61ef3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:09.592043 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d0c46637-67e4-43af-8566-31f29aa83d0b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:09.596092 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-d0c46637-67e4-43af-8566-31f29aa83d0b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:09.620752 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=26 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:09.634480 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d0c46637-67e4-43af-8566-31f29aa83d0b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:09.634480 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d0c46637-67e4-43af-8566-31f29aa83d0b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:09.634480 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d0c46637-67e4-43af-8566-31f29aa83d0b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:09.637508 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d0c46637-67e4-43af-8566-31f29aa83d0b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:09.669689 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-5d3f91a7-c00c-4136-bee6-4e7ca9f61ef3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:09.691484 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-5d3f91a7-c00c-4136-bee6-4e7ca9f61ef3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1366 microversion: 2.1 time: 0.298355 Aug 02 09:11:09.708777 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 35/76] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:09 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1366 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:09.766540 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d0c46637-67e4-43af-8566-31f29aa83d0b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:09.783407 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-d0c46637-67e4-43af-8566-31f29aa83d0b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1280 microversion: 2.1 time: 0.193102 Aug 02 09:11:09.783407 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 42/77] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:09 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1280 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:10.413849 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-e13da3e7-f6b3-4d9e-a2f3-71ea6a7140d5 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:10.414471 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-e13da3e7-f6b3-4d9e-a2f3-71ea6a7140d5 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:10.421505 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e13da3e7-f6b3-4d9e-a2f3-71ea6a7140d5 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:10.421950 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e13da3e7-f6b3-4d9e-a2f3-71ea6a7140d5 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:10.423048 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e13da3e7-f6b3-4d9e-a2f3-71ea6a7140d5 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:10.423545 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e13da3e7-f6b3-4d9e-a2f3-71ea6a7140d5 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:10.431785 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-8256d0f7-fa41-4510-b6bb-67b5c044d1f3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:10.432481 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-8256d0f7-fa41-4510-b6bb-67b5c044d1f3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:10.443731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8256d0f7-fa41-4510-b6bb-67b5c044d1f3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:10.444196 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8256d0f7-fa41-4510-b6bb-67b5c044d1f3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:10.454975 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8256d0f7-fa41-4510-b6bb-67b5c044d1f3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:10.460272 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8256d0f7-fa41-4510-b6bb-67b5c044d1f3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:11.038655 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-e13da3e7-f6b3-4d9e-a2f3-71ea6a7140d5 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:11.050756 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-e13da3e7-f6b3-4d9e-a2f3-71ea6a7140d5 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1314 microversion: 2.1 time: 0.641183 Aug 02 09:11:11.052916 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 36/78] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:10 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:11.080940 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-8256d0f7-fa41-4510-b6bb-67b5c044d1f3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:11.086651 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-f161180e-f863-4523-be84-06738cf121fc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:11.087613 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-f161180e-f863-4523-be84-06738cf121fc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:11.095108 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f161180e-f863-4523-be84-06738cf121fc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:11.103499 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f161180e-f863-4523-be84-06738cf121fc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:11.103499 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f161180e-f863-4523-be84-06738cf121fc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:11.103499 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f161180e-f863-4523-be84-06738cf121fc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:11.106642 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-8256d0f7-fa41-4510-b6bb-67b5c044d1f3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:11.112712 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-8256d0f7-fa41-4510-b6bb-67b5c044d1f3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:11.115373 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-8256d0f7-fa41-4510-b6bb-67b5c044d1f3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1406 microversion: 2.20 time: 0.687188 Aug 02 09:11:11.118853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 43/79] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:10 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1406 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:11.147183 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-b8044d1e-34f7-43e7-a95a-7765fc8c015d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:11.151594 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-b8044d1e-34f7-43e7-a95a-7765fc8c015d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:11.166955 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b8044d1e-34f7-43e7-a95a-7765fc8c015d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:11.167392 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b8044d1e-34f7-43e7-a95a-7765fc8c015d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:11.168570 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b8044d1e-34f7-43e7-a95a-7765fc8c015d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:11.169221 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b8044d1e-34f7-43e7-a95a-7765fc8c015d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:11.421846 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-b8044d1e-34f7-43e7-a95a-7765fc8c015d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:11.443802 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-b8044d1e-34f7-43e7-a95a-7765fc8c015d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1280 microversion: 2.1 time: 0.322277 Aug 02 09:11:11.453795 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 44/80] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:11 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1280 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:11.606522 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-f161180e-f863-4523-be84-06738cf121fc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:11.636293 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-f161180e-f863-4523-be84-06738cf121fc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1366 microversion: 2.1 time: 0.569078 Aug 02 09:11:11.642228 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 37/81] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:11 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1366 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:12.089835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4999bd4f-6b50-4b02-9926-510a687cbe5e tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:12.090856 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-4999bd4f-6b50-4b02-9926-510a687cbe5e tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:12.093921 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=6 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:12.112966 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4999bd4f-6b50-4b02-9926-510a687cbe5e tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:12.113713 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4999bd4f-6b50-4b02-9926-510a687cbe5e tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:12.115202 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4999bd4f-6b50-4b02-9926-510a687cbe5e tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:12.115991 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4999bd4f-6b50-4b02-9926-510a687cbe5e tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:12.147673 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-7bc4e7e0-8b75-4997-83fb-2f1ddab1a445 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:12.158912 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-7bc4e7e0-8b75-4997-83fb-2f1ddab1a445 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:12.181730 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7bc4e7e0-8b75-4997-83fb-2f1ddab1a445 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:12.181730 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7bc4e7e0-8b75-4997-83fb-2f1ddab1a445 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:12.183135 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7bc4e7e0-8b75-4997-83fb-2f1ddab1a445 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:12.192906 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7bc4e7e0-8b75-4997-83fb-2f1ddab1a445 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:12.703947 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-4999bd4f-6b50-4b02-9926-510a687cbe5e tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:12.718058 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-4999bd4f-6b50-4b02-9926-510a687cbe5e tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1314 microversion: 2.1 time: 0.633879 Aug 02 09:11:12.720734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-7bc4e7e0-8b75-4997-83fb-2f1ddab1a445 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:12.721693 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 45/82] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:12 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1314 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:12.735281 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-09795a75-aff6-43de-95e3-2a3c29530d2a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:12.737867 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-09795a75-aff6-43de-95e3-2a3c29530d2a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:12.747276 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-09795a75-aff6-43de-95e3-2a3c29530d2a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:12.749025 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-09795a75-aff6-43de-95e3-2a3c29530d2a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:12.750090 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-09795a75-aff6-43de-95e3-2a3c29530d2a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:12.750854 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-09795a75-aff6-43de-95e3-2a3c29530d2a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:12.752117 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-7bc4e7e0-8b75-4997-83fb-2f1ddab1a445 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:12.762142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-7bc4e7e0-8b75-4997-83fb-2f1ddab1a445 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:12.776152 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-7bc4e7e0-8b75-4997-83fb-2f1ddab1a445 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1406 microversion: 2.20 time: 0.637551 Aug 02 09:11:12.790963 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 38/83] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:12 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1406 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:12.813175 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-99cf73a8-eeb6-4c6e-83e9-f3e9dbd94017 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:12.823786 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-99cf73a8-eeb6-4c6e-83e9-f3e9dbd94017 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:12.852980 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-99cf73a8-eeb6-4c6e-83e9-f3e9dbd94017 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:12.853842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-99cf73a8-eeb6-4c6e-83e9-f3e9dbd94017 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:12.854826 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-99cf73a8-eeb6-4c6e-83e9-f3e9dbd94017 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:12.855645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-99cf73a8-eeb6-4c6e-83e9-f3e9dbd94017 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:13.351835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-09795a75-aff6-43de-95e3-2a3c29530d2a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:13.360426 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-09795a75-aff6-43de-95e3-2a3c29530d2a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1322 microversion: 2.1 time: 0.634176 Aug 02 09:11:13.365973 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 46/84] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:12 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1322 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:13.371704 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-2b6bac1f-67cc-42f4-a852-07b4e9ce1f9e req-9e53145c-3491-400a-aa7c-e6c7015cb427 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9660960-566d-48c4-b5a7-413789e0e2c7", "tag": "8b3c0897-2970-4809-9a52-2ac5fbdcafbe"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:13.399556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-2b6bac1f-67cc-42f4-a852-07b4e9ce1f9e req-9e53145c-3491-400a-aa7c-e6c7015cb427 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:13.411018 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-2b6bac1f-67cc-42f4-a852-07b4e9ce1f9e req-9e53145c-3491-400a-aa7c-e6c7015cb427 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:13.443776 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-2b6bac1f-67cc-42f4-a852-07b4e9ce1f9e req-9e53145c-3491-400a-aa7c-e6c7015cb427 service nova] Creating event network-changed:8b3c0897-2970-4809-9a52-2ac5fbdcafbe for instance f9660960-566d-48c4-b5a7-413789e0e2c7 on hv-cinder-84599 Aug 02 09:11:13.455255 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-2b6bac1f-67cc-42f4-a852-07b4e9ce1f9e req-9e53145c-3491-400a-aa7c-e6c7015cb427 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087120 Aug 02 09:11:13.458038 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 47/85] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:13.517221 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-99cf73a8-eeb6-4c6e-83e9-f3e9dbd94017 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:13.526135 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-99cf73a8-eeb6-4c6e-83e9-f3e9dbd94017 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1366 microversion: 2.1 time: 0.731300 Aug 02 09:11:13.526718 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 39/86] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:12 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1366 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:13.748227 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-9561f4d6-b95d-4afd-948c-d207e2e3ab4a tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:13.749092 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-9561f4d6-b95d-4afd-948c-d207e2e3ab4a tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:13.760743 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9561f4d6-b95d-4afd-948c-d207e2e3ab4a tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:13.761378 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9561f4d6-b95d-4afd-948c-d207e2e3ab4a tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:13.762263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9561f4d6-b95d-4afd-948c-d207e2e3ab4a tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:13.762774 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9561f4d6-b95d-4afd-948c-d207e2e3ab4a tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:13.819982 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-0ac550e1-7dfb-4fec-9740-9bd9c30cb9a9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:13.822795 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-0ac550e1-7dfb-4fec-9740-9bd9c30cb9a9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:13.838114 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0ac550e1-7dfb-4fec-9740-9bd9c30cb9a9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:13.838114 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0ac550e1-7dfb-4fec-9740-9bd9c30cb9a9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:13.850796 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0ac550e1-7dfb-4fec-9740-9bd9c30cb9a9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:13.850796 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0ac550e1-7dfb-4fec-9740-9bd9c30cb9a9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:14.452297 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-9561f4d6-b95d-4afd-948c-d207e2e3ab4a tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:14.464592 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-9561f4d6-b95d-4afd-948c-d207e2e3ab4a tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1314 microversion: 2.1 time: 0.720974 Aug 02 09:11:14.465841 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 48/87] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:13 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1314 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:14.471776 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-76857604-8a3f-4cbe-8ce5-62262b0a3d9a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:14.589787 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-0ac550e1-7dfb-4fec-9740-9bd9c30cb9a9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:14.589952 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-76857604-8a3f-4cbe-8ce5-62262b0a3d9a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:14.589952 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-76857604-8a3f-4cbe-8ce5-62262b0a3d9a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:14.589952 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-76857604-8a3f-4cbe-8ce5-62262b0a3d9a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:14.589952 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-76857604-8a3f-4cbe-8ce5-62262b0a3d9a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:14.590417 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-76857604-8a3f-4cbe-8ce5-62262b0a3d9a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:14.590571 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-0ac550e1-7dfb-4fec-9740-9bd9c30cb9a9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:14.590571 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-0ac550e1-7dfb-4fec-9740-9bd9c30cb9a9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:14.590571 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-0ac550e1-7dfb-4fec-9740-9bd9c30cb9a9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1406 microversion: 2.20 time: 0.692666 Aug 02 09:11:14.590904 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 40/88] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:13 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1406 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:11:14.590904 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-75519c1c-b9cf-4087-94a5-0a694365cd6a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:14.590904 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-75519c1c-b9cf-4087-94a5-0a694365cd6a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:14.590904 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-75519c1c-b9cf-4087-94a5-0a694365cd6a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:14.591358 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-75519c1c-b9cf-4087-94a5-0a694365cd6a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:14.591358 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-75519c1c-b9cf-4087-94a5-0a694365cd6a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:14.591358 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-75519c1c-b9cf-4087-94a5-0a694365cd6a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:14.907337 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-75519c1c-b9cf-4087-94a5-0a694365cd6a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:14.910592 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-76857604-8a3f-4cbe-8ce5-62262b0a3d9a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:14.919102 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-75519c1c-b9cf-4087-94a5-0a694365cd6a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1366 microversion: 2.1 time: 0.374288 Aug 02 09:11:14.920213 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 41/89] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:14 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1366 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:14.921302 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-76857604-8a3f-4cbe-8ce5-62262b0a3d9a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1322 microversion: 2.1 time: 0.453909 Aug 02 09:11:14.921879 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 49/90] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:14 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1322 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:15.487904 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-bf6ef233-34ce-496b-a011-281896b7fe07 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:15.488553 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-bf6ef233-34ce-496b-a011-281896b7fe07 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:15.496103 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bf6ef233-34ce-496b-a011-281896b7fe07 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:15.496695 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bf6ef233-34ce-496b-a011-281896b7fe07 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:15.497544 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bf6ef233-34ce-496b-a011-281896b7fe07 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:15.498030 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bf6ef233-34ce-496b-a011-281896b7fe07 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:15.526790 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-e5450383-4316-49d5-8a78-0158d3030651 req-d00876fd-f301-4a71-8c0e-51f78ad155bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cca7c83-368d-4c02-a00c-d12a84825c27", "tag": "8f442acd-437f-4082-97ec-7f28749a0a8b"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:15.541591 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-e5450383-4316-49d5-8a78-0158d3030651 req-d00876fd-f301-4a71-8c0e-51f78ad155bd service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:15.542090 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-e5450383-4316-49d5-8a78-0158d3030651 req-d00876fd-f301-4a71-8c0e-51f78ad155bd service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:15.562416 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-e5450383-4316-49d5-8a78-0158d3030651 req-d00876fd-f301-4a71-8c0e-51f78ad155bd service nova] Creating event network-changed:8f442acd-437f-4082-97ec-7f28749a0a8b for instance 6cca7c83-368d-4c02-a00c-d12a84825c27 on hv-cinder-84599 Aug 02 09:11:15.569562 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-e5450383-4316-49d5-8a78-0158d3030651 req-d00876fd-f301-4a71-8c0e-51f78ad155bd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051080 Aug 02 09:11:15.570186 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 50/91] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:11:15.644202 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-371e7193-5922-4500-b2ff-d7f9988b133d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:15.646428 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-371e7193-5922-4500-b2ff-d7f9988b133d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:15.654689 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-371e7193-5922-4500-b2ff-d7f9988b133d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:15.655242 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-371e7193-5922-4500-b2ff-d7f9988b133d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:15.656337 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-371e7193-5922-4500-b2ff-d7f9988b133d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:15.656986 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-371e7193-5922-4500-b2ff-d7f9988b133d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:15.822843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-bf6ef233-34ce-496b-a011-281896b7fe07 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:15.827223 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=100 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:15.841385 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-bf6ef233-34ce-496b-a011-281896b7fe07 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1314 microversion: 2.1 time: 0.357592 Aug 02 09:11:15.842685 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 42/92] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:15 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1314 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:15.853975 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-6abd6a21-5624-42d4-bc93-c15b05422b22 req-3bd138b4-2c0d-463e-830b-5b51193c1798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95f38f46-6f77-4c20-bfed-3f60c1fcfad2", "tag": "f874d599-d036-4473-8b0d-bac60f7e1f6d"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:15.869871 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-6abd6a21-5624-42d4-bc93-c15b05422b22 req-3bd138b4-2c0d-463e-830b-5b51193c1798 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:15.870593 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-6abd6a21-5624-42d4-bc93-c15b05422b22 req-3bd138b4-2c0d-463e-830b-5b51193c1798 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:15.897862 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-6abd6a21-5624-42d4-bc93-c15b05422b22 req-3bd138b4-2c0d-463e-830b-5b51193c1798 service nova] Creating event network-changed:f874d599-d036-4473-8b0d-bac60f7e1f6d for instance 95f38f46-6f77-4c20-bfed-3f60c1fcfad2 on hv-cinder-84599 Aug 02 09:11:15.898415 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-6abd6a21-5624-42d4-bc93-c15b05422b22 req-3bd138b4-2c0d-463e-830b-5b51193c1798 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118526) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Aug 02 09:11:15.899570 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0c92c5dc-8c02-4198-a2a7-aaccab8d67c6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:15.900003 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0c92c5dc-8c02-4198-a2a7-aaccab8d67c6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:15.900976 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0c92c5dc-8c02-4198-a2a7-aaccab8d67c6 None None] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:15.901471 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0c92c5dc-8c02-4198-a2a7-aaccab8d67c6 None None] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:15.901699 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-371e7193-5922-4500-b2ff-d7f9988b133d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:15.912267 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.compute.rpcapi [None req-0c92c5dc-8c02-4198-a2a7-aaccab8d67c6 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 02 09:11:15.913259 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0c92c5dc-8c02-4198-a2a7-aaccab8d67c6 None None] Releasing lock "compute-rpcapi-router" {{(pid=118526) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Aug 02 09:11:15.919510 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-371e7193-5922-4500-b2ff-d7f9988b133d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:15.924025 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-371e7193-5922-4500-b2ff-d7f9988b133d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:15.927811 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-371e7193-5922-4500-b2ff-d7f9988b133d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1406 microversion: 2.20 time: 0.292391 Aug 02 09:11:15.929096 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 51/93] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:15 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1406 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:15.940283 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-0c92c5dc-8c02-4198-a2a7-aaccab8d67c6 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088573 Aug 02 09:11:15.941745 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 43/94] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:15.955635 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-14d2d348-0e58-480b-bb8c-209447b036b1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:15.956747 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-14d2d348-0e58-480b-bb8c-209447b036b1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:15.958853 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-16acf411-286a-4147-8224-1da2540756d7 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:15.959568 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-16acf411-286a-4147-8224-1da2540756d7 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:15.964230 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-14d2d348-0e58-480b-bb8c-209447b036b1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:15.964540 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-14d2d348-0e58-480b-bb8c-209447b036b1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:15.965305 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-14d2d348-0e58-480b-bb8c-209447b036b1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:15.965776 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-14d2d348-0e58-480b-bb8c-209447b036b1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:15.966960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-16acf411-286a-4147-8224-1da2540756d7 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:15.967505 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-16acf411-286a-4147-8224-1da2540756d7 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:15.968417 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-16acf411-286a-4147-8224-1da2540756d7 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:15.969083 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-16acf411-286a-4147-8224-1da2540756d7 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:16.543644 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-16acf411-286a-4147-8224-1da2540756d7 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:16.555051 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-16acf411-286a-4147-8224-1da2540756d7 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1322 microversion: 2.1 time: 0.610544 Aug 02 09:11:16.556110 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 44/95] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:15 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1322 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:16.562450 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-14d2d348-0e58-480b-bb8c-209447b036b1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:16.568024 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=100 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:16.575962 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-14d2d348-0e58-480b-bb8c-209447b036b1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1366 microversion: 2.1 time: 0.637646 Aug 02 09:11:16.576948 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 52/96] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:15 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1366 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:16.867924 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-2b8b3cec-dff6-4caa-8afb-e7129682e44c tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:16.869386 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-2b8b3cec-dff6-4caa-8afb-e7129682e44c tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:16.879895 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2b8b3cec-dff6-4caa-8afb-e7129682e44c tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:16.880496 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2b8b3cec-dff6-4caa-8afb-e7129682e44c tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:16.881368 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2b8b3cec-dff6-4caa-8afb-e7129682e44c tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:16.881873 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2b8b3cec-dff6-4caa-8afb-e7129682e44c tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:16.984742 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ea9a1837-54f8-41d8-9188-4fbbd1134157 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:16.987303 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ea9a1837-54f8-41d8-9188-4fbbd1134157 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:16.998705 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ea9a1837-54f8-41d8-9188-4fbbd1134157 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:16.999482 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ea9a1837-54f8-41d8-9188-4fbbd1134157 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:17.001020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ea9a1837-54f8-41d8-9188-4fbbd1134157 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:17.001926 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ea9a1837-54f8-41d8-9188-4fbbd1134157 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:17.309504 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-2b8b3cec-dff6-4caa-8afb-e7129682e44c tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:17.338226 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-2b8b3cec-dff6-4caa-8afb-e7129682e44c tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1314 microversion: 2.1 time: 0.476310 Aug 02 09:11:17.347557 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 45/97] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:16 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1314 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:17.385441 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ea9a1837-54f8-41d8-9188-4fbbd1134157 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:17.397210 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ea9a1837-54f8-41d8-9188-4fbbd1134157 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:17.400633 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ea9a1837-54f8-41d8-9188-4fbbd1134157 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:17.402760 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ea9a1837-54f8-41d8-9188-4fbbd1134157 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1406 microversion: 2.20 time: 0.440207 Aug 02 09:11:17.412749 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 53/98] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:16 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1406 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:17.578836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-ac1d2303-0573-4779-b17e-2afb717deb89 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:17.580366 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-ac1d2303-0573-4779-b17e-2afb717deb89 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:17.590870 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ac1d2303-0573-4779-b17e-2afb717deb89 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:17.591319 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ac1d2303-0573-4779-b17e-2afb717deb89 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:17.592084 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ac1d2303-0573-4779-b17e-2afb717deb89 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:17.592541 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ac1d2303-0573-4779-b17e-2afb717deb89 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:17.606776 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-269cf136-1409-49f1-8ef3-9a3228ac4798 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:17.610109 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-269cf136-1409-49f1-8ef3-9a3228ac4798 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:17.624826 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-269cf136-1409-49f1-8ef3-9a3228ac4798 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:17.625738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-269cf136-1409-49f1-8ef3-9a3228ac4798 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:17.627270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-269cf136-1409-49f1-8ef3-9a3228ac4798 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:17.628112 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-269cf136-1409-49f1-8ef3-9a3228ac4798 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:17.958224 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-ac1d2303-0573-4779-b17e-2afb717deb89 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:18.006314 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-ac1d2303-0573-4779-b17e-2afb717deb89 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1322 microversion: 2.1 time: 0.431490 Aug 02 09:11:18.012857 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 46/99] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:17 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1322 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:18.321196 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-269cf136-1409-49f1-8ef3-9a3228ac4798 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:18.349086 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-269cf136-1409-49f1-8ef3-9a3228ac4798 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1366 microversion: 2.1 time: 0.750506 Aug 02 09:11:18.364209 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 54/100] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:17 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1366 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:18.364634 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-93cccda4-2afb-466e-8d9f-09dd24286d5a req-c39be658-781a-46a0-ae37-9d135da548e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b99c5502-ef55-4e1e-a47c-c708aaf2b0ff", "name": "network-vif-plugged", "status": "completed", "tag": "16c5e6c0-6e16-42f7-ae1b-1356afbca34d"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:18.377634 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-482eb721-7fcd-4b17-adce-ae7fdc69ee5d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:18.378773 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-482eb721-7fcd-4b17-adce-ae7fdc69ee5d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:18.389200 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-93cccda4-2afb-466e-8d9f-09dd24286d5a req-c39be658-781a-46a0-ae37-9d135da548e6 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:18.390251 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-93cccda4-2afb-466e-8d9f-09dd24286d5a req-c39be658-781a-46a0-ae37-9d135da548e6 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:18.393923 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-482eb721-7fcd-4b17-adce-ae7fdc69ee5d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:18.394577 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-482eb721-7fcd-4b17-adce-ae7fdc69ee5d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:18.396556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-482eb721-7fcd-4b17-adce-ae7fdc69ee5d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:18.406465 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-482eb721-7fcd-4b17-adce-ae7fdc69ee5d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:18.435483 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-93cccda4-2afb-466e-8d9f-09dd24286d5a req-c39be658-781a-46a0-ae37-9d135da548e6 service nova] Creating event network-vif-plugged:16c5e6c0-6e16-42f7-ae1b-1356afbca34d for instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff on hv-cinder-84599 Aug 02 09:11:18.461066 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-93cccda4-2afb-466e-8d9f-09dd24286d5a req-c39be658-781a-46a0-ae37-9d135da548e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.232256 Aug 02 09:11:18.462021 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 47/101] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:11:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:11:18.482690 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-761ce666-ac1e-4463-9c6e-4ad2a1ebfc32 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:18.485596 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-761ce666-ac1e-4463-9c6e-4ad2a1ebfc32 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:18.503586 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-761ce666-ac1e-4463-9c6e-4ad2a1ebfc32 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:18.507638 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-761ce666-ac1e-4463-9c6e-4ad2a1ebfc32 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:18.508799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-761ce666-ac1e-4463-9c6e-4ad2a1ebfc32 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:18.509332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-761ce666-ac1e-4463-9c6e-4ad2a1ebfc32 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:19.121498 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-482eb721-7fcd-4b17-adce-ae7fdc69ee5d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:19.139327 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-761ce666-ac1e-4463-9c6e-4ad2a1ebfc32 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:19.142753 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-482eb721-7fcd-4b17-adce-ae7fdc69ee5d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1314 microversion: 2.1 time: 0.770749 Aug 02 09:11:19.145472 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 55/102] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:18 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1314 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:19.153787 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ebd4cf62-ff2d-4df7-b759-1168372e16cb tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:19.155633 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ebd4cf62-ff2d-4df7-b759-1168372e16cb tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:19.174974 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-761ce666-ac1e-4463-9c6e-4ad2a1ebfc32 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:19.177354 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-761ce666-ac1e-4463-9c6e-4ad2a1ebfc32 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:19.179119 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-761ce666-ac1e-4463-9c6e-4ad2a1ebfc32 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1406 microversion: 2.20 time: 0.707635 Aug 02 09:11:19.183654 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 48/103] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:18 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1406 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:19.188975 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ebd4cf62-ff2d-4df7-b759-1168372e16cb tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:19.191464 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ebd4cf62-ff2d-4df7-b759-1168372e16cb tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:19.196696 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ebd4cf62-ff2d-4df7-b759-1168372e16cb tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:19.198002 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ebd4cf62-ff2d-4df7-b759-1168372e16cb tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:19.392836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-87874b59-5efc-49b3-9dd6-e6163fe3aed6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:19.394198 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-87874b59-5efc-49b3-9dd6-e6163fe3aed6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:19.404429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-87874b59-5efc-49b3-9dd6-e6163fe3aed6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:19.405980 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-87874b59-5efc-49b3-9dd6-e6163fe3aed6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:19.407374 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-87874b59-5efc-49b3-9dd6-e6163fe3aed6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:19.408086 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-87874b59-5efc-49b3-9dd6-e6163fe3aed6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:19.707544 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ebd4cf62-ff2d-4df7-b759-1168372e16cb tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:19.717365 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ebd4cf62-ff2d-4df7-b759-1168372e16cb tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1322 microversion: 2.1 time: 0.569668 Aug 02 09:11:19.717976 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 56/104] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:19 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1322 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:20.005715 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-87874b59-5efc-49b3-9dd6-e6163fe3aed6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:20.020716 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-87874b59-5efc-49b3-9dd6-e6163fe3aed6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1366 microversion: 2.1 time: 0.640930 Aug 02 09:11:20.021614 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 49/105] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:19 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1366 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:20.179658 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-21d7d727-7838-42e3-b403-8dd0eaa195ff tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:20.182031 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-21d7d727-7838-42e3-b403-8dd0eaa195ff tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:20.203819 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-21d7d727-7838-42e3-b403-8dd0eaa195ff tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:20.203819 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-21d7d727-7838-42e3-b403-8dd0eaa195ff tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:20.205964 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-21d7d727-7838-42e3-b403-8dd0eaa195ff tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:20.206810 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-21d7d727-7838-42e3-b403-8dd0eaa195ff tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:20.226375 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a2884726-5ce1-454f-8f10-2ccf6aa6cf8d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:20.228663 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-a2884726-5ce1-454f-8f10-2ccf6aa6cf8d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:20.249157 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a2884726-5ce1-454f-8f10-2ccf6aa6cf8d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:20.249903 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a2884726-5ce1-454f-8f10-2ccf6aa6cf8d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:20.258116 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a2884726-5ce1-454f-8f10-2ccf6aa6cf8d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:20.261392 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a2884726-5ce1-454f-8f10-2ccf6aa6cf8d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:20.561027 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-21d7d727-7838-42e3-b403-8dd0eaa195ff tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:20.575286 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-21d7d727-7838-42e3-b403-8dd0eaa195ff tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1314 microversion: 2.1 time: 0.406749 Aug 02 09:11:20.578299 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 57/106] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:20 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:20.609119 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-a2884726-5ce1-454f-8f10-2ccf6aa6cf8d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:20.621550 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-a2884726-5ce1-454f-8f10-2ccf6aa6cf8d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:20.623380 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-a2884726-5ce1-454f-8f10-2ccf6aa6cf8d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:20.624598 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-a2884726-5ce1-454f-8f10-2ccf6aa6cf8d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1406 microversion: 2.20 time: 0.405954 Aug 02 09:11:20.625620 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 50/107] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:20 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1406 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:20.740713 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-520c7f59-025b-4436-ba72-cbc1b2cf7a89 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:20.742380 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-520c7f59-025b-4436-ba72-cbc1b2cf7a89 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:20.750587 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-520c7f59-025b-4436-ba72-cbc1b2cf7a89 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:20.751927 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-520c7f59-025b-4436-ba72-cbc1b2cf7a89 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:20.753036 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-520c7f59-025b-4436-ba72-cbc1b2cf7a89 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:20.753644 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-520c7f59-025b-4436-ba72-cbc1b2cf7a89 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:21.010341 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-520c7f59-025b-4436-ba72-cbc1b2cf7a89 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:21.025235 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-520c7f59-025b-4436-ba72-cbc1b2cf7a89 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1322 microversion: 2.1 time: 0.289603 Aug 02 09:11:21.026268 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 58/108] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:20 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:21.060127 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a77b774e-5eb3-418c-854c-87c3beed17e9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:21.061193 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-a77b774e-5eb3-418c-854c-87c3beed17e9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:21.071978 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a77b774e-5eb3-418c-854c-87c3beed17e9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:21.072756 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a77b774e-5eb3-418c-854c-87c3beed17e9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:21.073875 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a77b774e-5eb3-418c-854c-87c3beed17e9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:21.076349 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a77b774e-5eb3-418c-854c-87c3beed17e9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:21.265523 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-a77b774e-5eb3-418c-854c-87c3beed17e9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:21.281489 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-a77b774e-5eb3-418c-854c-87c3beed17e9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1366 microversion: 2.1 time: 0.226009 Aug 02 09:11:21.282928 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 51/109] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:21 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:21.608216 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-33170aef-c467-443c-9997-508f079eb487 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:21.609223 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-33170aef-c467-443c-9997-508f079eb487 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:21.618126 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-33170aef-c467-443c-9997-508f079eb487 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:21.619252 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-33170aef-c467-443c-9997-508f079eb487 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:21.622005 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-33170aef-c467-443c-9997-508f079eb487 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:21.623695 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-33170aef-c467-443c-9997-508f079eb487 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:21.682702 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-42669a1d-8b51-4fd6-97f6-2733d5caf3aa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:21.682702 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-42669a1d-8b51-4fd6-97f6-2733d5caf3aa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:21.685113 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-42669a1d-8b51-4fd6-97f6-2733d5caf3aa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:21.685562 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-42669a1d-8b51-4fd6-97f6-2733d5caf3aa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:21.690189 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-42669a1d-8b51-4fd6-97f6-2733d5caf3aa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:21.691004 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-42669a1d-8b51-4fd6-97f6-2733d5caf3aa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:21.947899 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-33170aef-c467-443c-9997-508f079eb487 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:21.964367 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-33170aef-c467-443c-9997-508f079eb487 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1314 microversion: 2.1 time: 0.365558 Aug 02 09:11:21.969954 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-42669a1d-8b51-4fd6-97f6-2733d5caf3aa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:21.974732 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 59/110] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:21 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:21.979883 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-42669a1d-8b51-4fd6-97f6-2733d5caf3aa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:21.982650 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-42669a1d-8b51-4fd6-97f6-2733d5caf3aa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:21.984240 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-42669a1d-8b51-4fd6-97f6-2733d5caf3aa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1406 microversion: 2.20 time: 0.314533 Aug 02 09:11:21.984519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 52/111] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:21 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1406 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:11:22.047614 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-b8d6358e-0353-4e35-a3f2-384adba522bd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:22.048318 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-b8d6358e-0353-4e35-a3f2-384adba522bd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:22.057863 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b8d6358e-0353-4e35-a3f2-384adba522bd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:22.058347 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b8d6358e-0353-4e35-a3f2-384adba522bd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:22.059395 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b8d6358e-0353-4e35-a3f2-384adba522bd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:22.059842 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b8d6358e-0353-4e35-a3f2-384adba522bd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:22.240414 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-15a243dc-fb56-4c84-89e8-14ef5a71796a req-8bfc2ba3-82f5-459b-b92e-ef551237ca54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44854eb9-caa3-4fc7-bd14-6a150fcafcd3", "name": "network-vif-plugged", "status": "completed", "tag": "da035960-2909-47c1-95e2-3f882cc28445"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:22.251507 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-b8d6358e-0353-4e35-a3f2-384adba522bd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:22.265232 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-15a243dc-fb56-4c84-89e8-14ef5a71796a req-8bfc2ba3-82f5-459b-b92e-ef551237ca54 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:22.266242 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-15a243dc-fb56-4c84-89e8-14ef5a71796a req-8bfc2ba3-82f5-459b-b92e-ef551237ca54 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:22.267587 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-b8d6358e-0353-4e35-a3f2-384adba522bd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1322 microversion: 2.1 time: 0.223784 Aug 02 09:11:22.286735 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 60/112] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:22 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:22.306067 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-15a243dc-fb56-4c84-89e8-14ef5a71796a req-8bfc2ba3-82f5-459b-b92e-ef551237ca54 service nova] Creating event network-vif-plugged:da035960-2909-47c1-95e2-3f882cc28445 for instance 44854eb9-caa3-4fc7-bd14-6a150fcafcd3 on hv-cinder-84599 Aug 02 09:11:22.310464 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-27fd61e6-133b-4dea-8174-a3b62f133087 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:22.315187 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-27fd61e6-133b-4dea-8174-a3b62f133087 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:22.317675 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-15a243dc-fb56-4c84-89e8-14ef5a71796a req-8bfc2ba3-82f5-459b-b92e-ef551237ca54 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083062 Aug 02 09:11:22.320747 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 53/113] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:11:22.326238 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-27fd61e6-133b-4dea-8174-a3b62f133087 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:22.326935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-27fd61e6-133b-4dea-8174-a3b62f133087 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:22.328305 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-27fd61e6-133b-4dea-8174-a3b62f133087 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:22.329043 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-27fd61e6-133b-4dea-8174-a3b62f133087 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:22.530574 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-27fd61e6-133b-4dea-8174-a3b62f133087 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:22.544361 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-27fd61e6-133b-4dea-8174-a3b62f133087 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1366 microversion: 2.1 time: 0.241172 Aug 02 09:11:22.545658 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 61/114] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:22 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:22.996983 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a15fd381-f722-4fa7-852f-95ae0575f59f tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:22.998967 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-a15fd381-f722-4fa7-852f-95ae0575f59f tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:23.017216 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a15fd381-f722-4fa7-852f-95ae0575f59f tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:23.030772 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-34130d38-62c0-4db6-bac2-2a39be81c938 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:23.030772 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-34130d38-62c0-4db6-bac2-2a39be81c938 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:23.031803 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a15fd381-f722-4fa7-852f-95ae0575f59f tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:23.034584 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a15fd381-f722-4fa7-852f-95ae0575f59f tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:23.036782 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a15fd381-f722-4fa7-852f-95ae0575f59f tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:23.085813 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-34130d38-62c0-4db6-bac2-2a39be81c938 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:23.086629 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-34130d38-62c0-4db6-bac2-2a39be81c938 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:23.088056 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-34130d38-62c0-4db6-bac2-2a39be81c938 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:23.101335 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-34130d38-62c0-4db6-bac2-2a39be81c938 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:23.719274 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-a15fd381-f722-4fa7-852f-95ae0575f59f tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:23.759055 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-a15fd381-f722-4fa7-852f-95ae0575f59f tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1314 microversion: 2.1 time: 0.774298 Aug 02 09:11:23.760133 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 54/115] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:22 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1314 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:23.765436 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-7ffd6adf-2680-4b8b-8275-f96f90366042 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:23.766065 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-7ffd6adf-2680-4b8b-8275-f96f90366042 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:23.777561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7ffd6adf-2680-4b8b-8275-f96f90366042 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:23.778007 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7ffd6adf-2680-4b8b-8275-f96f90366042 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:23.781502 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7ffd6adf-2680-4b8b-8275-f96f90366042 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:23.783454 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7ffd6adf-2680-4b8b-8275-f96f90366042 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:23.856930 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-34130d38-62c0-4db6-bac2-2a39be81c938 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:23.899399 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-34130d38-62c0-4db6-bac2-2a39be81c938 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:23.912193 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-34130d38-62c0-4db6-bac2-2a39be81c938 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:23.915367 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-34130d38-62c0-4db6-bac2-2a39be81c938 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1406 microversion: 2.20 time: 0.894878 Aug 02 09:11:23.921758 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 62/116] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:23 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1406 bytes in 902 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:23.937279 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-7021f47e-dcde-4b6c-afb9-a1ca0be30952 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:23.938156 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-7021f47e-dcde-4b6c-afb9-a1ca0be30952 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:23.953798 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7021f47e-dcde-4b6c-afb9-a1ca0be30952 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:23.955576 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7021f47e-dcde-4b6c-afb9-a1ca0be30952 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:23.956660 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7021f47e-dcde-4b6c-afb9-a1ca0be30952 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:23.957148 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7021f47e-dcde-4b6c-afb9-a1ca0be30952 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:24.381505 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-7ffd6adf-2680-4b8b-8275-f96f90366042 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:24.397691 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-7ffd6adf-2680-4b8b-8275-f96f90366042 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1322 microversion: 2.1 time: 0.636123 Aug 02 09:11:24.417704 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 55/117] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:23 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1322 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:24.425491 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-840b8760-cbd8-4361-a0b5-c317ef4aacb4 req-d305a3cc-97c5-4a80-9624-4caac011cd18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cca7c83-368d-4c02-a00c-d12a84825c27", "name": "network-vif-plugged", "status": "completed", "tag": "8f442acd-437f-4082-97ec-7f28749a0a8b"}, {"server_uuid": "f9660960-566d-48c4-b5a7-413789e0e2c7", "name": "network-vif-plugged", "status": "completed", "tag": "8b3c0897-2970-4809-9a52-2ac5fbdcafbe"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:24.441109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-840b8760-cbd8-4361-a0b5-c317ef4aacb4 req-d305a3cc-97c5-4a80-9624-4caac011cd18 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:24.442007 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-840b8760-cbd8-4361-a0b5-c317ef4aacb4 req-d305a3cc-97c5-4a80-9624-4caac011cd18 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:24.463895 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-840b8760-cbd8-4361-a0b5-c317ef4aacb4 req-d305a3cc-97c5-4a80-9624-4caac011cd18 service nova] Creating event network-vif-plugged:8f442acd-437f-4082-97ec-7f28749a0a8b for instance 6cca7c83-368d-4c02-a00c-d12a84825c27 on hv-cinder-84599 Aug 02 09:11:24.464830 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-840b8760-cbd8-4361-a0b5-c317ef4aacb4 req-d305a3cc-97c5-4a80-9624-4caac011cd18 service nova] Creating event network-vif-plugged:8b3c0897-2970-4809-9a52-2ac5fbdcafbe for instance f9660960-566d-48c4-b5a7-413789e0e2c7 on hv-cinder-84599 Aug 02 09:11:24.469423 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-7021f47e-dcde-4b6c-afb9-a1ca0be30952 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:24.478652 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-840b8760-cbd8-4361-a0b5-c317ef4aacb4 req-d305a3cc-97c5-4a80-9624-4caac011cd18 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059717 Aug 02 09:11:24.480110 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 56/118] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:24.483303 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-7021f47e-dcde-4b6c-afb9-a1ca0be30952 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1366 microversion: 2.1 time: 0.560285 Aug 02 09:11:24.484270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 63/119] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:23 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1366 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:24.805759 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-4ad2abe0-bbdf-4e5e-8aff-0e6d36ee8e2d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:24.806816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-4ad2abe0-bbdf-4e5e-8aff-0e6d36ee8e2d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:24.809650 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:24.818535 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4ad2abe0-bbdf-4e5e-8aff-0e6d36ee8e2d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:24.819371 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4ad2abe0-bbdf-4e5e-8aff-0e6d36ee8e2d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:24.820668 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4ad2abe0-bbdf-4e5e-8aff-0e6d36ee8e2d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:24.821651 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4ad2abe0-bbdf-4e5e-8aff-0e6d36ee8e2d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:25.003244 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-cbb0c167-a1ed-4663-bcd8-1394254d9b59 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:25.009249 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-cbb0c167-a1ed-4663-bcd8-1394254d9b59 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:25.035008 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cbb0c167-a1ed-4663-bcd8-1394254d9b59 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:25.044240 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cbb0c167-a1ed-4663-bcd8-1394254d9b59 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:25.046333 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cbb0c167-a1ed-4663-bcd8-1394254d9b59 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:25.051167 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cbb0c167-a1ed-4663-bcd8-1394254d9b59 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:25.059422 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-4ad2abe0-bbdf-4e5e-8aff-0e6d36ee8e2d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:25.087658 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-4ad2abe0-bbdf-4e5e-8aff-0e6d36ee8e2d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1500 microversion: 2.1 time: 0.287768 Aug 02 09:11:25.090017 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 57/120] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:24 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1500 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:25.347103 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-cbb0c167-a1ed-4663-bcd8-1394254d9b59 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:25.358248 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-cbb0c167-a1ed-4663-bcd8-1394254d9b59 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:25.361005 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-cbb0c167-a1ed-4663-bcd8-1394254d9b59 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:25.364447 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-cbb0c167-a1ed-4663-bcd8-1394254d9b59 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1406 microversion: 2.20 time: 0.404350 Aug 02 09:11:25.366667 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 64/121] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:24 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1406 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:25.432484 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-e159de90-03f6-4f10-8aff-a123d5a86b4b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:25.433091 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-e159de90-03f6-4f10-8aff-a123d5a86b4b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:25.443931 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e159de90-03f6-4f10-8aff-a123d5a86b4b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:25.443931 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e159de90-03f6-4f10-8aff-a123d5a86b4b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:25.443931 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e159de90-03f6-4f10-8aff-a123d5a86b4b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:25.443931 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e159de90-03f6-4f10-8aff-a123d5a86b4b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:25.512234 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-8fb0177e-da84-4fd9-a886-8f7a310ae53c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:25.513359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-8fb0177e-da84-4fd9-a886-8f7a310ae53c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:25.526883 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8fb0177e-da84-4fd9-a886-8f7a310ae53c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:25.527681 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8fb0177e-da84-4fd9-a886-8f7a310ae53c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:25.535356 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8fb0177e-da84-4fd9-a886-8f7a310ae53c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:25.536873 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8fb0177e-da84-4fd9-a886-8f7a310ae53c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:25.837481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-e159de90-03f6-4f10-8aff-a123d5a86b4b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:25.853529 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-e159de90-03f6-4f10-8aff-a123d5a86b4b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1322 microversion: 2.1 time: 0.426403 Aug 02 09:11:25.854886 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 58/122] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:25 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1322 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:25.878818 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-8fb0177e-da84-4fd9-a886-8f7a310ae53c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:25.887827 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-8fb0177e-da84-4fd9-a886-8f7a310ae53c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1366 microversion: 2.1 time: 0.384753 Aug 02 09:11:25.888462 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 65/123] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:25 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1366 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:26.398697 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-91912d79-70e1-485b-b757-f48c82104f7b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:26.400036 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-91912d79-70e1-485b-b757-f48c82104f7b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:26.402418 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=2 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:26.409476 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-91912d79-70e1-485b-b757-f48c82104f7b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:26.409990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-91912d79-70e1-485b-b757-f48c82104f7b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:26.411111 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-91912d79-70e1-485b-b757-f48c82104f7b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:26.411836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-91912d79-70e1-485b-b757-f48c82104f7b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:26.595557 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-91912d79-70e1-485b-b757-f48c82104f7b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:26.613234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-91912d79-70e1-485b-b757-f48c82104f7b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:26.618289 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-91912d79-70e1-485b-b757-f48c82104f7b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:26.618804 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-91912d79-70e1-485b-b757-f48c82104f7b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1406 microversion: 2.20 time: 0.225578 Aug 02 09:11:26.620057 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 59/124] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:26 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:26.878421 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-3f6f948f-95f2-4931-b0a2-54f4a4e45165 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:26.879443 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-3f6f948f-95f2-4931-b0a2-54f4a4e45165 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:26.894782 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3f6f948f-95f2-4931-b0a2-54f4a4e45165 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:26.896831 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3f6f948f-95f2-4931-b0a2-54f4a4e45165 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:26.897813 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3f6f948f-95f2-4931-b0a2-54f4a4e45165 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:26.898351 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3f6f948f-95f2-4931-b0a2-54f4a4e45165 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:26.929946 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-722c3dec-7c03-4ea0-920e-08d55f692da3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:26.930804 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-722c3dec-7c03-4ea0-920e-08d55f692da3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:26.937915 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-722c3dec-7c03-4ea0-920e-08d55f692da3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:26.938657 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-722c3dec-7c03-4ea0-920e-08d55f692da3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:26.939492 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-722c3dec-7c03-4ea0-920e-08d55f692da3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:26.939957 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-722c3dec-7c03-4ea0-920e-08d55f692da3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:27.156639 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-3f6f948f-95f2-4931-b0a2-54f4a4e45165 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:27.174128 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-3f6f948f-95f2-4931-b0a2-54f4a4e45165 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1322 microversion: 2.1 time: 0.297788 Aug 02 09:11:27.193837 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 66/125] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:26 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:27.202042 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-722c3dec-7c03-4ea0-920e-08d55f692da3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:27.213245 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-722c3dec-7c03-4ea0-920e-08d55f692da3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1366 microversion: 2.1 time: 0.290430 Aug 02 09:11:27.214089 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 60/126] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:26 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1366 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:27.369074 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-92f7554f-e637-4b66-9695-df8c8b917bd8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07dda4ee-8a2e-4c82-ae0c-17e953f04060"}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:27.374198 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-92f7554f-e637-4b66-9695-df8c8b917bd8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:27.388081 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-92f7554f-e637-4b66-9695-df8c8b917bd8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:27.389002 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-92f7554f-e637-4b66-9695-df8c8b917bd8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:27.390135 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-92f7554f-e637-4b66-9695-df8c8b917bd8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:27.390685 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-92f7554f-e637-4b66-9695-df8c8b917bd8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:27.652000 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-d2aa6cac-34fa-4153-805e-3466b45eb205 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:27.652804 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-d2aa6cac-34fa-4153-805e-3466b45eb205 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:27.660623 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d2aa6cac-34fa-4153-805e-3466b45eb205 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:27.661682 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d2aa6cac-34fa-4153-805e-3466b45eb205 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:27.662510 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d2aa6cac-34fa-4153-805e-3466b45eb205 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:27.662974 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d2aa6cac-34fa-4153-805e-3466b45eb205 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:27.874515 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-d2aa6cac-34fa-4153-805e-3466b45eb205 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:27.878870 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=100 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:27.893053 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-d2aa6cac-34fa-4153-805e-3466b45eb205 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:27.894511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-d2aa6cac-34fa-4153-805e-3466b45eb205 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:27.897471 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-d2aa6cac-34fa-4153-805e-3466b45eb205 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1406 microversion: 2.20 time: 0.249027 Aug 02 09:11:27.902112 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 61/127] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:27 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1406 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:11:28.200653 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-139e1491-11fe-431b-8353-e99ae32cf506 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:28.201257 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-139e1491-11fe-431b-8353-e99ae32cf506 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:28.212001 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-139e1491-11fe-431b-8353-e99ae32cf506 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:28.212832 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-139e1491-11fe-431b-8353-e99ae32cf506 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:28.214927 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-139e1491-11fe-431b-8353-e99ae32cf506 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:28.215506 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-139e1491-11fe-431b-8353-e99ae32cf506 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:28.497152 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-139e1491-11fe-431b-8353-e99ae32cf506 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:28.506245 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-139e1491-11fe-431b-8353-e99ae32cf506 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1322 microversion: 2.1 time: 0.311423 Aug 02 09:11:28.506835 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 62/128] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:28 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1322 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:28.511729 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-0340ea13-25ea-482b-a362-5282c880fa33 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:28.512375 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-0340ea13-25ea-482b-a362-5282c880fa33 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:28.519393 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0340ea13-25ea-482b-a362-5282c880fa33 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:28.519889 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0340ea13-25ea-482b-a362-5282c880fa33 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:28.521531 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0340ea13-25ea-482b-a362-5282c880fa33 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:28.521970 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0340ea13-25ea-482b-a362-5282c880fa33 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:28.688883 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-0340ea13-25ea-482b-a362-5282c880fa33 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:28.701335 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-0340ea13-25ea-482b-a362-5282c880fa33 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1366 microversion: 2.1 time: 0.193255 Aug 02 09:11:28.702220 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 63/129] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:28 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1366 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:28.935932 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c2e826a3-c384-4d19-8e36-b66e96d4bddc tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:28.937713 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-c2e826a3-c384-4d19-8e36-b66e96d4bddc tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:28.951383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c2e826a3-c384-4d19-8e36-b66e96d4bddc tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:28.952573 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c2e826a3-c384-4d19-8e36-b66e96d4bddc tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:28.954781 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c2e826a3-c384-4d19-8e36-b66e96d4bddc tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:28.955991 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c2e826a3-c384-4d19-8e36-b66e96d4bddc tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:29.182136 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-c2e826a3-c384-4d19-8e36-b66e96d4bddc tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:29.191395 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-c2e826a3-c384-4d19-8e36-b66e96d4bddc tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:29.193651 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-c2e826a3-c384-4d19-8e36-b66e96d4bddc tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:29.194828 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-c2e826a3-c384-4d19-8e36-b66e96d4bddc tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1406 microversion: 2.20 time: 0.268446 Aug 02 09:11:29.195750 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 64/130] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:28 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1406 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:11:29.238023 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-92f7554f-e637-4b66-9695-df8c8b917bd8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "POST /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.879844 Aug 02 09:11:29.247236 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 67/131] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 2 09:11:27 2022] POST /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff/os-volume_attachments => generated 194 bytes in 1882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:29.305412 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-60f09c04-681d-4ef5-9bb6-f7c4b34d0ffe req-5c1b4601-18d0-4c92-9968-004323d17436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f38f46-6f77-4c20-bfed-3f60c1fcfad2", "name": "network-vif-plugged", "status": "completed", "tag": "f874d599-d036-4473-8b0d-bac60f7e1f6d"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:29.337602 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-60f09c04-681d-4ef5-9bb6-f7c4b34d0ffe req-5c1b4601-18d0-4c92-9968-004323d17436 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:29.338474 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-60f09c04-681d-4ef5-9bb6-f7c4b34d0ffe req-5c1b4601-18d0-4c92-9968-004323d17436 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:29.354771 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-60f09c04-681d-4ef5-9bb6-f7c4b34d0ffe req-5c1b4601-18d0-4c92-9968-004323d17436 service nova] Creating event network-vif-plugged:f874d599-d036-4473-8b0d-bac60f7e1f6d for instance 95f38f46-6f77-4c20-bfed-3f60c1fcfad2 on hv-cinder-84599 Aug 02 09:11:29.361998 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-60f09c04-681d-4ef5-9bb6-f7c4b34d0ffe req-5c1b4601-18d0-4c92-9968-004323d17436 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061804 Aug 02 09:11:29.362686 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 65/132] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:11:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:29.533783 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ed5f2f13-8129-4275-8c41-2eb9e151c1bd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:29.535186 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ed5f2f13-8129-4275-8c41-2eb9e151c1bd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:29.546916 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ed5f2f13-8129-4275-8c41-2eb9e151c1bd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:29.547745 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ed5f2f13-8129-4275-8c41-2eb9e151c1bd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:29.549264 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ed5f2f13-8129-4275-8c41-2eb9e151c1bd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:29.550069 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ed5f2f13-8129-4275-8c41-2eb9e151c1bd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:29.558891 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:29.734397 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-f1abf88c-2235-4d18-a9e0-4df48ccaa753 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:29.744215 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-f1abf88c-2235-4d18-a9e0-4df48ccaa753 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:29.772493 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f1abf88c-2235-4d18-a9e0-4df48ccaa753 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:29.772493 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f1abf88c-2235-4d18-a9e0-4df48ccaa753 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:29.774275 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f1abf88c-2235-4d18-a9e0-4df48ccaa753 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:29.774275 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f1abf88c-2235-4d18-a9e0-4df48ccaa753 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:29.846367 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ed5f2f13-8129-4275-8c41-2eb9e151c1bd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:29.869350 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ed5f2f13-8129-4275-8c41-2eb9e151c1bd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1322 microversion: 2.1 time: 0.340505 Aug 02 09:11:29.870383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 68/133] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:29 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1322 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:30.024406 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-f1abf88c-2235-4d18-a9e0-4df48ccaa753 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:30.036833 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-f1abf88c-2235-4d18-a9e0-4df48ccaa753 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1366 microversion: 2.1 time: 0.313579 Aug 02 09:11:30.052010 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 66/134] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:29 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:30.221843 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d52d9e3e-6989-4a04-87e6-9c065f18a849 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:30.222563 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-d52d9e3e-6989-4a04-87e6-9c065f18a849 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:30.236595 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d52d9e3e-6989-4a04-87e6-9c065f18a849 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:30.238552 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d52d9e3e-6989-4a04-87e6-9c065f18a849 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:30.240614 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d52d9e3e-6989-4a04-87e6-9c065f18a849 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:30.241395 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d52d9e3e-6989-4a04-87e6-9c065f18a849 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:30.456530 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d52d9e3e-6989-4a04-87e6-9c065f18a849 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:30.467053 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d52d9e3e-6989-4a04-87e6-9c065f18a849 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:30.469229 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d52d9e3e-6989-4a04-87e6-9c065f18a849 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:30.470440 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-d52d9e3e-6989-4a04-87e6-9c065f18a849 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1406 microversion: 2.20 time: 0.255105 Aug 02 09:11:30.471074 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 69/135] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:30 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:11:30.905983 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-1bbb680e-177a-4e31-accf-a81a9ca321ac tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:30.907169 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-1bbb680e-177a-4e31-accf-a81a9ca321ac tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:30.919243 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1bbb680e-177a-4e31-accf-a81a9ca321ac tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:30.919824 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1bbb680e-177a-4e31-accf-a81a9ca321ac tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:30.920687 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1bbb680e-177a-4e31-accf-a81a9ca321ac tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:30.921204 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1bbb680e-177a-4e31-accf-a81a9ca321ac tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:31.063915 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-93e46429-5520-4165-82a3-fa35c703f40a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:31.065274 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-93e46429-5520-4165-82a3-fa35c703f40a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:31.076368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-93e46429-5520-4165-82a3-fa35c703f40a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:31.077041 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-93e46429-5520-4165-82a3-fa35c703f40a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:31.078221 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-93e46429-5520-4165-82a3-fa35c703f40a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:31.078790 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-93e46429-5520-4165-82a3-fa35c703f40a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:31.310299 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-1bbb680e-177a-4e31-accf-a81a9ca321ac tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:31.368363 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-1bbb680e-177a-4e31-accf-a81a9ca321ac tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1322 microversion: 2.1 time: 0.469595 Aug 02 09:11:31.369509 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 67/136] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:30 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:31.412915 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-93e46429-5520-4165-82a3-fa35c703f40a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:31.425385 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-93e46429-5520-4165-82a3-fa35c703f40a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1556 microversion: 2.1 time: 0.369090 Aug 02 09:11:31.427605 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 70/137] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:31 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1556 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:31.458516 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b578b351-e8bf-450c-9937-8fc364a9b94b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:31.459021 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b578b351-e8bf-450c-9937-8fc364a9b94b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:31.487253 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b578b351-e8bf-450c-9937-8fc364a9b94b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:31.487253 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b578b351-e8bf-450c-9937-8fc364a9b94b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:31.487253 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b578b351-e8bf-450c-9937-8fc364a9b94b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:31.487253 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b578b351-e8bf-450c-9937-8fc364a9b94b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:31.515585 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-fcfd353b-584e-4fe1-8587-5851c3e86f34 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:31.516346 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-fcfd353b-584e-4fe1-8587-5851c3e86f34 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:31.524336 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fcfd353b-584e-4fe1-8587-5851c3e86f34 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:31.525160 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fcfd353b-584e-4fe1-8587-5851c3e86f34 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:31.526159 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fcfd353b-584e-4fe1-8587-5851c3e86f34 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:31.526799 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fcfd353b-584e-4fe1-8587-5851c3e86f34 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:31.750502 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b578b351-e8bf-450c-9937-8fc364a9b94b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.298753 Aug 02 09:11:31.750847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 68/138] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Aug 2 09:11:31 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7/os-interface => generated 284 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:31.792555 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-fcfd353b-584e-4fe1-8587-5851c3e86f34 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:31.803293 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-fcfd353b-584e-4fe1-8587-5851c3e86f34 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:31.805384 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-fcfd353b-584e-4fe1-8587-5851c3e86f34 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:31.806663 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-fcfd353b-584e-4fe1-8587-5851c3e86f34 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1598 microversion: 2.20 time: 0.299335 Aug 02 09:11:31.807896 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 71/139] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:11:31 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1598 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:11:31.835535 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-68f62dbb-dad4-45d1-9ecc-99e651d45ce0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:31.836041 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-68f62dbb-dad4-45d1-9ecc-99e651d45ce0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:31.844819 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-68f62dbb-dad4-45d1-9ecc-99e651d45ce0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:31.845726 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-68f62dbb-dad4-45d1-9ecc-99e651d45ce0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:31.846695 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-68f62dbb-dad4-45d1-9ecc-99e651d45ce0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:31.847134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-68f62dbb-dad4-45d1-9ecc-99e651d45ce0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:31.952058 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-68f62dbb-dad4-45d1-9ecc-99e651d45ce0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.123484 Aug 02 09:11:31.960358 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 69/140] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Aug 2 09:11:31 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27/os-interface => generated 285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:11:32.409333 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-3f2cf20f-b4eb-4f53-a5a1-dfe316347fbe tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:32.420323 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-3f2cf20f-b4eb-4f53-a5a1-dfe316347fbe tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:32.464180 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3f2cf20f-b4eb-4f53-a5a1-dfe316347fbe tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:32.465177 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3f2cf20f-b4eb-4f53-a5a1-dfe316347fbe tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:32.468129 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3f2cf20f-b4eb-4f53-a5a1-dfe316347fbe tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:32.469421 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3f2cf20f-b4eb-4f53-a5a1-dfe316347fbe tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:33.486745 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-3f2cf20f-b4eb-4f53-a5a1-dfe316347fbe tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:33.502890 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-3f2cf20f-b4eb-4f53-a5a1-dfe316347fbe tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1322 microversion: 2.1 time: 1.100650 Aug 02 09:11:33.513569 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 72/141] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:32 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1322 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:34.296378 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-cc6dc530-f816-4f23-b850-a6237a7e07eb req-6b0d4aba-11e2-4a1a-a997-dced687f1af4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9660960-566d-48c4-b5a7-413789e0e2c7", "tag": "8b3c0897-2970-4809-9a52-2ac5fbdcafbe"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:34.309387 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-cc6dc530-f816-4f23-b850-a6237a7e07eb req-6b0d4aba-11e2-4a1a-a997-dced687f1af4 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:34.309738 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-cc6dc530-f816-4f23-b850-a6237a7e07eb req-6b0d4aba-11e2-4a1a-a997-dced687f1af4 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:34.324259 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-cc6dc530-f816-4f23-b850-a6237a7e07eb req-6b0d4aba-11e2-4a1a-a997-dced687f1af4 service nova] Creating event network-changed:8b3c0897-2970-4809-9a52-2ac5fbdcafbe for instance f9660960-566d-48c4-b5a7-413789e0e2c7 on hv-cinder-84599 Aug 02 09:11:34.331868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-cc6dc530-f816-4f23-b850-a6237a7e07eb req-6b0d4aba-11e2-4a1a-a997-dced687f1af4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041024 Aug 02 09:11:34.333814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 70/142] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:34.530578 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-a992388d-741c-4dc9-85e3-2791d747a7b0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:34.532997 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-a992388d-741c-4dc9-85e3-2791d747a7b0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:34.608145 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a992388d-741c-4dc9-85e3-2791d747a7b0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:34.631783 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a992388d-741c-4dc9-85e3-2791d747a7b0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:34.633276 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a992388d-741c-4dc9-85e3-2791d747a7b0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:34.634011 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a992388d-741c-4dc9-85e3-2791d747a7b0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:34.766951 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-5911ec28-ea45-4bd0-8af3-594c1fbf4979 req-6d863513-d962-4e5b-8e25-b6e545cee210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cca7c83-368d-4c02-a00c-d12a84825c27", "tag": "8f442acd-437f-4082-97ec-7f28749a0a8b"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:34.812450 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-5911ec28-ea45-4bd0-8af3-594c1fbf4979 req-6d863513-d962-4e5b-8e25-b6e545cee210 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:34.813167 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-5911ec28-ea45-4bd0-8af3-594c1fbf4979 req-6d863513-d962-4e5b-8e25-b6e545cee210 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:34.861733 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-5911ec28-ea45-4bd0-8af3-594c1fbf4979 req-6d863513-d962-4e5b-8e25-b6e545cee210 service nova] Creating event network-changed:8f442acd-437f-4082-97ec-7f28749a0a8b for instance 6cca7c83-368d-4c02-a00c-d12a84825c27 on hv-cinder-84599 Aug 02 09:11:34.878242 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-5911ec28-ea45-4bd0-8af3-594c1fbf4979 req-6d863513-d962-4e5b-8e25-b6e545cee210 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119352 Aug 02 09:11:34.884836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 71/143] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:35.681108 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-a992388d-741c-4dc9-85e3-2791d747a7b0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:35.711940 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-a992388d-741c-4dc9-85e3-2791d747a7b0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1516 microversion: 2.1 time: 1.187468 Aug 02 09:11:35.724615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 73/144] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:34 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1516 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:35.735759 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-173535ca-a452-44ff-b589-ba59704d7f95 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:35.740599 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-173535ca-a452-44ff-b589-ba59704d7f95 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:35.750379 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-173535ca-a452-44ff-b589-ba59704d7f95 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:35.751680 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-173535ca-a452-44ff-b589-ba59704d7f95 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:35.753323 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-173535ca-a452-44ff-b589-ba59704d7f95 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:35.755099 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-173535ca-a452-44ff-b589-ba59704d7f95 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:35.817145 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.objects.instance [None req-173535ca-a452-44ff-b589-ba59704d7f95 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lazy-loading 'flavor' on Instance uuid 95f38f46-6f77-4c20-bfed-3f60c1fcfad2 {{(pid=118526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:11:36.426205 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-173535ca-a452-44ff-b589-ba59704d7f95 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "POST /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2/action" status: 200 len: 32 microversion: 2.1 time: 0.694335 Aug 02 09:11:36.426205 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 72/145] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 2 09:11:35 2022] POST /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2/action => generated 32 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 09:11:36.445249 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-1c5d648a-6400-45ef-8af6-d8ad56a86f91 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:36.448849 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-1c5d648a-6400-45ef-8af6-d8ad56a86f91 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:36.468529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=80 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:36.516129 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1c5d648a-6400-45ef-8af6-d8ad56a86f91 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:36.524855 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1c5d648a-6400-45ef-8af6-d8ad56a86f91 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:36.528878 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1c5d648a-6400-45ef-8af6-d8ad56a86f91 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:36.532589 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1c5d648a-6400-45ef-8af6-d8ad56a86f91 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:37.027206 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-1c5d648a-6400-45ef-8af6-d8ad56a86f91 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:37.040584 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-1c5d648a-6400-45ef-8af6-d8ad56a86f91 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.605218 Aug 02 09:11:37.043474 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 74/146] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:36 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:38.085845 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-7c6ee17a-d46e-4043-957c-bfe57f5bc736 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:38.087570 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-7c6ee17a-d46e-4043-957c-bfe57f5bc736 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:38.111029 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7c6ee17a-d46e-4043-957c-bfe57f5bc736 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:38.111491 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7c6ee17a-d46e-4043-957c-bfe57f5bc736 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:38.113816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7c6ee17a-d46e-4043-957c-bfe57f5bc736 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:38.117327 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7c6ee17a-d46e-4043-957c-bfe57f5bc736 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:38.350227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-7c6ee17a-d46e-4043-957c-bfe57f5bc736 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:38.358324 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-7c6ee17a-d46e-4043-957c-bfe57f5bc736 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.278624 Aug 02 09:11:38.359218 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 73/147] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:38 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:39.385356 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-e2a82a19-133b-4041-8193-5f4013961839 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:39.386464 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-e2a82a19-133b-4041-8193-5f4013961839 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:39.399509 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e2a82a19-133b-4041-8193-5f4013961839 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:39.403292 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e2a82a19-133b-4041-8193-5f4013961839 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:39.403292 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e2a82a19-133b-4041-8193-5f4013961839 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:39.403292 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e2a82a19-133b-4041-8193-5f4013961839 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:39.656599 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-e2a82a19-133b-4041-8193-5f4013961839 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:39.679778 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-e2a82a19-133b-4041-8193-5f4013961839 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.301313 Aug 02 09:11:39.681363 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 75/148] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:39 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:40.714488 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-3e60de19-0128-4f01-8e6d-bbd50796be01 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:40.731046 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-3e60de19-0128-4f01-8e6d-bbd50796be01 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:40.731046 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3e60de19-0128-4f01-8e6d-bbd50796be01 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:40.731046 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3e60de19-0128-4f01-8e6d-bbd50796be01 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:40.731046 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3e60de19-0128-4f01-8e6d-bbd50796be01 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:40.732528 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3e60de19-0128-4f01-8e6d-bbd50796be01 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:41.003170 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-3e60de19-0128-4f01-8e6d-bbd50796be01 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:41.003170 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-3e60de19-0128-4f01-8e6d-bbd50796be01 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.282753 Aug 02 09:11:41.003170 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 74/149] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:40 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:42.011972 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-112d5fcd-3873-4d19-88ce-ed1e34ce0803 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:42.012733 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-112d5fcd-3873-4d19-88ce-ed1e34ce0803 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:42.022597 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-112d5fcd-3873-4d19-88ce-ed1e34ce0803 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:42.023243 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-112d5fcd-3873-4d19-88ce-ed1e34ce0803 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:42.024427 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-112d5fcd-3873-4d19-88ce-ed1e34ce0803 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:42.025074 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-112d5fcd-3873-4d19-88ce-ed1e34ce0803 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:42.049464 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-40cc9e03-b6b2-4eec-b1cb-ac89872ed46d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:42.050284 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-40cc9e03-b6b2-4eec-b1cb-ac89872ed46d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:42.059764 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-40cc9e03-b6b2-4eec-b1cb-ac89872ed46d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:42.060499 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-40cc9e03-b6b2-4eec-b1cb-ac89872ed46d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:42.068008 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-40cc9e03-b6b2-4eec-b1cb-ac89872ed46d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:42.068008 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-40cc9e03-b6b2-4eec-b1cb-ac89872ed46d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:42.091464 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-40cc9e03-b6b2-4eec-b1cb-ac89872ed46d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Going to try to terminate instance {{(pid=118526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:11:42.233238 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-112d5fcd-3873-4d19-88ce-ed1e34ce0803 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:42.242229 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-112d5fcd-3873-4d19-88ce-ed1e34ce0803 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.234402 Aug 02 09:11:42.242887 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 76/150] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:42 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:42.484702 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-40cc9e03-b6b2-4eec-b1cb-ac89872ed46d tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 204 len: 0 microversion: 2.1 time: 0.438906 Aug 02 09:11:42.485508 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 75/151] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:11:42 2022] DELETE /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:11:42.495151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d623fa7d-29c7-4ac1-b30d-5a7aae4f862b tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:42.496073 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-d623fa7d-29c7-4ac1-b30d-5a7aae4f862b tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:42.503381 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d623fa7d-29c7-4ac1-b30d-5a7aae4f862b tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:42.503950 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d623fa7d-29c7-4ac1-b30d-5a7aae4f862b tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:42.505913 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d623fa7d-29c7-4ac1-b30d-5a7aae4f862b tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:42.506575 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d623fa7d-29c7-4ac1-b30d-5a7aae4f862b tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:42.703680 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d623fa7d-29c7-4ac1-b30d-5a7aae4f862b tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:42.713630 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-d623fa7d-29c7-4ac1-b30d-5a7aae4f862b tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1552 microversion: 2.1 time: 0.223262 Aug 02 09:11:42.714264 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 77/152] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:42 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1552 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:43.269075 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-0811c5f0-70ef-4851-bfff-f778bfea13cf tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:43.271034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-0811c5f0-70ef-4851-bfff-f778bfea13cf tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:43.293643 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0811c5f0-70ef-4851-bfff-f778bfea13cf tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:43.294499 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0811c5f0-70ef-4851-bfff-f778bfea13cf tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:43.296538 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0811c5f0-70ef-4851-bfff-f778bfea13cf tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:43.297341 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0811c5f0-70ef-4851-bfff-f778bfea13cf tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:43.498961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-0811c5f0-70ef-4851-bfff-f778bfea13cf tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:43.523676 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-0811c5f0-70ef-4851-bfff-f778bfea13cf tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.262288 Aug 02 09:11:43.524830 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 76/153] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:43 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:43.738347 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-16eac099-e296-4a58-81e9-ae810ebb27a2 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:43.739248 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-16eac099-e296-4a58-81e9-ae810ebb27a2 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:43.746909 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-16eac099-e296-4a58-81e9-ae810ebb27a2 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:43.747472 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-16eac099-e296-4a58-81e9-ae810ebb27a2 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:43.748343 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-16eac099-e296-4a58-81e9-ae810ebb27a2 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:43.748779 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-16eac099-e296-4a58-81e9-ae810ebb27a2 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:43.928568 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-16eac099-e296-4a58-81e9-ae810ebb27a2 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:43.938973 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-16eac099-e296-4a58-81e9-ae810ebb27a2 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1552 microversion: 2.1 time: 0.204839 Aug 02 09:11:43.939568 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 78/154] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:43 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1552 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:44.560804 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-7d1cd471-c0cc-4d44-bef3-4d42d4a2e388 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:44.562141 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-7d1cd471-c0cc-4d44-bef3-4d42d4a2e388 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:44.573930 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7d1cd471-c0cc-4d44-bef3-4d42d4a2e388 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:44.574842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7d1cd471-c0cc-4d44-bef3-4d42d4a2e388 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:44.576849 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7d1cd471-c0cc-4d44-bef3-4d42d4a2e388 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:44.577946 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7d1cd471-c0cc-4d44-bef3-4d42d4a2e388 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:44.596418 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:44.778904 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-7d1cd471-c0cc-4d44-bef3-4d42d4a2e388 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:44.799788 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-7d1cd471-c0cc-4d44-bef3-4d42d4a2e388 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.246691 Aug 02 09:11:44.800839 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 77/155] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:44 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:44.963279 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ae140802-9269-4d99-aa2c-4960472e9547 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:44.964776 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ae140802-9269-4d99-aa2c-4960472e9547 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:44.973552 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ae140802-9269-4d99-aa2c-4960472e9547 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:44.974607 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ae140802-9269-4d99-aa2c-4960472e9547 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:44.975643 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ae140802-9269-4d99-aa2c-4960472e9547 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:44.976401 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ae140802-9269-4d99-aa2c-4960472e9547 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:45.246864 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ae140802-9269-4d99-aa2c-4960472e9547 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:45.272141 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ae140802-9269-4d99-aa2c-4960472e9547 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1552 microversion: 2.1 time: 0.312286 Aug 02 09:11:45.287269 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 79/156] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:44 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1552 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:45.839180 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-e6287a1d-7771-487a-8db5-701b762b466f tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:45.839950 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-e6287a1d-7771-487a-8db5-701b762b466f tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:45.853630 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e6287a1d-7771-487a-8db5-701b762b466f tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:45.856742 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e6287a1d-7771-487a-8db5-701b762b466f tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:45.856742 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e6287a1d-7771-487a-8db5-701b762b466f tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:45.856742 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e6287a1d-7771-487a-8db5-701b762b466f tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:46.055142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-e6287a1d-7771-487a-8db5-701b762b466f tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:46.070523 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-e6287a1d-7771-487a-8db5-701b762b466f tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.249009 Aug 02 09:11:46.073609 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 78/157] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:45 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:46.313140 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-e4690785-b937-4361-b3d3-625df6192645 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:46.319454 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-e4690785-b937-4361-b3d3-625df6192645 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:46.383834 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e4690785-b937-4361-b3d3-625df6192645 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:46.384635 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e4690785-b937-4361-b3d3-625df6192645 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:46.387139 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e4690785-b937-4361-b3d3-625df6192645 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:46.387139 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e4690785-b937-4361-b3d3-625df6192645 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:46.501798 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-e4690785-b937-4361-b3d3-625df6192645 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:46.520649 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-e4690785-b937-4361-b3d3-625df6192645 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1510 microversion: 2.1 time: 0.213783 Aug 02 09:11:46.521500 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 80/158] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:46 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1510 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:46.646633 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-045e1df3-12a5-49a4-a376-72edccd9c88d req-028c105a-42be-46ec-be5c-dbe5168059d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b99c5502-ef55-4e1e-a47c-c708aaf2b0ff", "name": "network-vif-deleted", "tag": "16c5e6c0-6e16-42f7-ae1b-1356afbca34d"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:11:46.675279 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-045e1df3-12a5-49a4-a376-72edccd9c88d req-028c105a-42be-46ec-be5c-dbe5168059d0 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:46.677244 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-045e1df3-12a5-49a4-a376-72edccd9c88d req-028c105a-42be-46ec-be5c-dbe5168059d0 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:46.700389 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-045e1df3-12a5-49a4-a376-72edccd9c88d req-028c105a-42be-46ec-be5c-dbe5168059d0 service nova] Creating event network-vif-deleted:16c5e6c0-6e16-42f7-ae1b-1356afbca34d for instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff on hv-cinder-84599 Aug 02 09:11:46.709918 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-045e1df3-12a5-49a4-a376-72edccd9c88d req-028c105a-42be-46ec-be5c-dbe5168059d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073341 Aug 02 09:11:46.711155 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 79/159] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:11:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:11:47.099814 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-1efe8e83-c61b-40c6-be53-d9e4efa634f1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:47.101319 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-1efe8e83-c61b-40c6-be53-d9e4efa634f1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:47.110674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1efe8e83-c61b-40c6-be53-d9e4efa634f1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:47.111828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1efe8e83-c61b-40c6-be53-d9e4efa634f1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:47.113473 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1efe8e83-c61b-40c6-be53-d9e4efa634f1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:47.114201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1efe8e83-c61b-40c6-be53-d9e4efa634f1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:47.328925 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-1efe8e83-c61b-40c6-be53-d9e4efa634f1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:47.343385 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-1efe8e83-c61b-40c6-be53-d9e4efa634f1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.250984 Aug 02 09:11:47.344444 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 81/160] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:47 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:47.573134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-1d7cfb88-0dc9-48d9-82a2-9e819dedaa05 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:47.575375 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-1d7cfb88-0dc9-48d9-82a2-9e819dedaa05 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:47.588511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1d7cfb88-0dc9-48d9-82a2-9e819dedaa05 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:47.589278 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1d7cfb88-0dc9-48d9-82a2-9e819dedaa05 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:47.590807 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1d7cfb88-0dc9-48d9-82a2-9e819dedaa05 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:47.591489 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1d7cfb88-0dc9-48d9-82a2-9e819dedaa05 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:47.702148 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-1d7cfb88-0dc9-48d9-82a2-9e819dedaa05 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:47.717765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-1d7cfb88-0dc9-48d9-82a2-9e819dedaa05 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1345 microversion: 2.1 time: 0.153342 Aug 02 09:11:47.719294 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 80/161] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:47 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1345 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:48.393273 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-416827d8-119d-40d3-bdda-f37f178fef7c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:48.394257 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-416827d8-119d-40d3-bdda-f37f178fef7c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:48.405963 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-416827d8-119d-40d3-bdda-f37f178fef7c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:48.407287 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-416827d8-119d-40d3-bdda-f37f178fef7c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:48.409421 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-416827d8-119d-40d3-bdda-f37f178fef7c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:48.410280 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-416827d8-119d-40d3-bdda-f37f178fef7c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:48.638932 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-416827d8-119d-40d3-bdda-f37f178fef7c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:48.654690 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-416827d8-119d-40d3-bdda-f37f178fef7c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.279418 Aug 02 09:11:48.661596 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 82/162] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:48 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:48.742884 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-4b469e2d-7293-48a5-b879-0f13f053bf65 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:48.743814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-4b469e2d-7293-48a5-b879-0f13f053bf65 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:48.751187 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4b469e2d-7293-48a5-b879-0f13f053bf65 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:48.751645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4b469e2d-7293-48a5-b879-0f13f053bf65 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:48.752494 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4b469e2d-7293-48a5-b879-0f13f053bf65 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:48.753001 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4b469e2d-7293-48a5-b879-0f13f053bf65 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:48.795843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4b469e2d-7293-48a5-b879-0f13f053bf65 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:48.796337 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4b469e2d-7293-48a5-b879-0f13f053bf65 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:48.796865 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.objects.instance [None req-4b469e2d-7293-48a5-b879-0f13f053bf65 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lazy-loading 'fault' on Instance uuid b99c5502-ef55-4e1e-a47c-c708aaf2b0ff {{(pid=118526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:11:48.865228 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-4b469e2d-7293-48a5-b879-0f13f053bf65 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed8d0b552b03417c9db1f5fc2bef05b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53df83f23dcf439aae2c867c57df57e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:48.877533 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-4b469e2d-7293-48a5-b879-0f13f053bf65 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 200 len: 1350 microversion: 2.1 time: 0.139732 Aug 02 09:11:48.880601 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 81/163] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:48 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 1350 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:49.696479 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ffa3ce3c-7530-4f9d-8f13-4e1cf59da4b4 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:49.698881 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ffa3ce3c-7530-4f9d-8f13-4e1cf59da4b4 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:49.710583 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ffa3ce3c-7530-4f9d-8f13-4e1cf59da4b4 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:49.711342 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ffa3ce3c-7530-4f9d-8f13-4e1cf59da4b4 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:49.712872 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ffa3ce3c-7530-4f9d-8f13-4e1cf59da4b4 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:49.713616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ffa3ce3c-7530-4f9d-8f13-4e1cf59da4b4 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:49.921348 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-430b7d9f-76ae-48cb-a1de-924d73ed52e8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:49.922775 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-430b7d9f-76ae-48cb-a1de-924d73ed52e8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:49.934959 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-430b7d9f-76ae-48cb-a1de-924d73ed52e8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:49.935956 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-430b7d9f-76ae-48cb-a1de-924d73ed52e8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:49.937598 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-430b7d9f-76ae-48cb-a1de-924d73ed52e8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:49.938643 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-430b7d9f-76ae-48cb-a1de-924d73ed52e8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:49.971156 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ffa3ce3c-7530-4f9d-8f13-4e1cf59da4b4 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:49.979147 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-430b7d9f-76ae-48cb-a1de-924d73ed52e8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] HTTP exception thrown: Instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff could not be found. Aug 02 09:11:49.984937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-430b7d9f-76ae-48cb-a1de-924d73ed52e8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Request method failure captured: Aug 02 09:11:49.984937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff HTTP/1.1 Aug 02 09:11:49.984937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:11:49.984937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:11:49.984937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:11:49.984937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:11:49.984937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:11:49.984937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:11:49.984937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:11:49.984937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:11:49.984937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OoEetQO9qVaf9gjFrASro6Hd11p_NQuJXB5KwL9ErMYzG6RJSZrEZOkpfBtwuD8Haf0vDWVjgzVNf58A6PplDY-dO1NupWH7ARHRxh7Q-Uwn8qX6-AHdOuvNn1-YdsxPl8VAZx0TsRBoGDbuklgB7f6DIIT-fM8C1znj0N__p3RQYA Aug 02 09:11:49.984937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:11:49.984937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:11:49.984937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:11:49.984937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:11:49.984937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:11:49.984937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:11:49.984937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: 53df83f23dcf439aae2c867c57df57e0 Aug 02 09:11:49.984937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-DeleteServersTestJSON-1769789556 Aug 02 09:11:49.984937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:11:49.984937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:11:49.986414 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53df83f23dcf439aae2c867c57df57e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/53df83f23dcf439aae2c867c57df57e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53df83f23dcf439aae2c867c57df57e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_53df83f23dcf439aae2c867c57df57e0"}]}] Aug 02 09:11:49.986414 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-DeleteServersTestJSON-1769789556 Aug 02 09:11:49.986414 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: 53df83f23dcf439aae2c867c57df57e0 Aug 02 09:11:49.986414 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-DeleteServersTestJSON-1769789556 Aug 02 09:11:49.986414 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-DeleteServersTestJSON-1769789556-project Aug 02 09:11:49.986414 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:11:49.986414 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:11:49.986414 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: ed8d0b552b03417c9db1f5fc2bef05b2 Aug 02 09:11:49.986414 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-DeleteServersTestJSON-1769789556-project Aug 02 09:11:49.986414 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:11:49.986414 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff could not be found. Aug 02 09:11:49.986414 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'id': 'b99c5502-ef55-4e1e-a47c-c708aaf2b0ff'} Aug 02 09:11:49.987219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:11:49.987219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:11:49.987219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:11:49.987219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:11:49.987219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:11:49.987219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:11:49.987219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:11:49.987219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:11:49.987219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:11:49.987219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:11:49.987219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff could not be found. Aug 02 09:11:49.987219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:11:49.987219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:11:49.987219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:11:49.987219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:11:49.987219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:11:49.987219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:11:49.987219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:11:49.987219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:11:49.987219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:11:49.988481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:11:49.988481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:11:49.988481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:11:49.988481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:11:49.988481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:11:49.988481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:11:49.988481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:11:49.988481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff could not be found. Aug 02 09:11:49.988481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:11:49.988481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:11:49.988481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:11:49.988481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:11:49.988481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:11:49.988481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:11:49.988481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:11:49.988481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:11:49.988481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff could not be found. Aug 02 09:11:49.988481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:11:49.989685 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ffa3ce3c-7530-4f9d-8f13-4e1cf59da4b4 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.296286 Aug 02 09:11:49.991819 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-430b7d9f-76ae-48cb-a1de-924d73ed52e8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Returning 404 to user: Instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff could not be found. {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:11:49.992960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-430b7d9f-76ae-48cb-a1de-924d73ed52e8 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 404 len: 111 microversion: 2.1 time: 0.079062 Aug 02 09:11:49.995210 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 82/164] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:49 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 09:11:50.006271 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 83/165] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:49 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:50.187885 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-e6ee470e-f06d-432e-a870-f93bf033a9ef tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:50.193312 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-e6ee470e-f06d-432e-a870-f93bf033a9ef tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:50.205888 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e6ee470e-f06d-432e-a870-f93bf033a9ef tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:50.207206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e6ee470e-f06d-432e-a870-f93bf033a9ef tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:50.209309 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e6ee470e-f06d-432e-a870-f93bf033a9ef tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:50.210514 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e6ee470e-f06d-432e-a870-f93bf033a9ef tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:50.241337 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-e6ee470e-f06d-432e-a870-f93bf033a9ef tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] HTTP exception thrown: Instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff could not be found. Aug 02 09:11:50.245344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-e6ee470e-f06d-432e-a870-f93bf033a9ef tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Request method failure captured: Aug 02 09:11:50.245344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff/os-volume_attachments HTTP/1.1 Aug 02 09:11:50.245344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:11:50.245344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:11:50.245344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:11:50.245344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:11:50.245344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:11:50.245344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:11:50.245344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:11:50.245344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:11:50.245344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OoEetQO9qVaf9gjFrASro6Hd11p_NQuJXB5KwL9ErMYzG6RJSZrEZOkpfBtwuD8Haf0vDWVjgzVNf58A6PplDY-dO1NupWH7ARHRxh7Q-Uwn8qX6-AHdOuvNn1-YdsxPl8VAZx0TsRBoGDbuklgB7f6DIIT-fM8C1znj0N__p3RQYA Aug 02 09:11:50.245344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:11:50.245344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:11:50.245344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:11:50.245344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:11:50.245344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:11:50.245344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:11:50.245344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: 53df83f23dcf439aae2c867c57df57e0 Aug 02 09:11:50.245344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-DeleteServersTestJSON-1769789556 Aug 02 09:11:50.245344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:11:50.245344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:11:50.256974 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53df83f23dcf439aae2c867c57df57e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/53df83f23dcf439aae2c867c57df57e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53df83f23dcf439aae2c867c57df57e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_53df83f23dcf439aae2c867c57df57e0"}]}] Aug 02 09:11:50.256974 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-DeleteServersTestJSON-1769789556 Aug 02 09:11:50.256974 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: 53df83f23dcf439aae2c867c57df57e0 Aug 02 09:11:50.256974 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-DeleteServersTestJSON-1769789556 Aug 02 09:11:50.256974 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-DeleteServersTestJSON-1769789556-project Aug 02 09:11:50.256974 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:11:50.256974 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:11:50.256974 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: ed8d0b552b03417c9db1f5fc2bef05b2 Aug 02 09:11:50.256974 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-DeleteServersTestJSON-1769789556-project Aug 02 09:11:50.256974 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:11:50.256974 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff could not be found. Aug 02 09:11:50.256974 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'server_id': 'b99c5502-ef55-4e1e-a47c-c708aaf2b0ff'} Aug 02 09:11:50.261749 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:11:50.261749 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:11:50.261749 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:11:50.261749 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:11:50.261749 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:11:50.261749 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:11:50.261749 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:11:50.261749 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:11:50.261749 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:11:50.261749 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:11:50.261749 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff could not be found. Aug 02 09:11:50.261749 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:11:50.261749 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:11:50.261749 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:11:50.261749 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:11:50.261749 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:11:50.261749 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:11:50.261749 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:11:50.261749 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:11:50.261749 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:11:50.264079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:11:50.264079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 09:11:50.264079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:11:50.264079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 02 09:11:50.264079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:11:50.264079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 02 09:11:50.264079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 02 09:11:50.264079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:11:50.264079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:11:50.264079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff could not be found. Aug 02 09:11:50.264079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:11:50.264079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:11:50.264079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:11:50.264079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:11:50.264079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:11:50.264079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:11:50.264079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:11:50.264079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:11:50.264079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff could not be found. Aug 02 09:11:50.264079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:11:50.267250 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-e6ee470e-f06d-432e-a870-f93bf033a9ef tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Returning 404 to user: Instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff could not be found. {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:11:50.267250 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-e6ee470e-f06d-432e-a870-f93bf033a9ef tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.067739 Aug 02 09:11:50.267250 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 83/166] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:11:50 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff/os-volume_attachments => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:11:51.024453 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-0e2fabf0-e58a-4308-acab-23c6d0adebbe tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:51.025237 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-0e2fabf0-e58a-4308-acab-23c6d0adebbe tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:51.033531 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0e2fabf0-e58a-4308-acab-23c6d0adebbe tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:51.034358 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0e2fabf0-e58a-4308-acab-23c6d0adebbe tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:51.035993 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0e2fabf0-e58a-4308-acab-23c6d0adebbe tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:51.036870 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0e2fabf0-e58a-4308-acab-23c6d0adebbe tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:51.230489 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-0e2fabf0-e58a-4308-acab-23c6d0adebbe tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:51.232868 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=100 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:51.243698 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-0e2fabf0-e58a-4308-acab-23c6d0adebbe tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.224623 Aug 02 09:11:51.246862 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 84/167] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:51 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:52.279046 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-f8fb798b-77b1-47b5-8dbe-817623884c7f tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:52.280563 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-f8fb798b-77b1-47b5-8dbe-817623884c7f tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:52.288815 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f8fb798b-77b1-47b5-8dbe-817623884c7f tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:52.289256 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f8fb798b-77b1-47b5-8dbe-817623884c7f tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:52.290227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f8fb798b-77b1-47b5-8dbe-817623884c7f tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:52.291029 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f8fb798b-77b1-47b5-8dbe-817623884c7f tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:52.507035 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-f8fb798b-77b1-47b5-8dbe-817623884c7f tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:52.518016 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-f8fb798b-77b1-47b5-8dbe-817623884c7f tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.242821 Aug 02 09:11:52.519075 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 84/168] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:52 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:52.819874 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-b6b5d496-273c-4109-aafb-42c679e2c71c tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:52.820896 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-b6b5d496-273c-4109-aafb-42c679e2c71c tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:52.834386 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b6b5d496-273c-4109-aafb-42c679e2c71c tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:52.835612 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b6b5d496-273c-4109-aafb-42c679e2c71c tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:52.837109 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b6b5d496-273c-4109-aafb-42c679e2c71c tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:52.838156 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b6b5d496-273c-4109-aafb-42c679e2c71c tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:52.859518 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-b6b5d496-273c-4109-aafb-42c679e2c71c tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] HTTP exception thrown: Instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff could not be found. Aug 02 09:11:52.865674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-b6b5d496-273c-4109-aafb-42c679e2c71c tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Request method failure captured: Aug 02 09:11:52.865674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: DELETE /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff HTTP/1.1 Aug 02 09:11:52.865674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:11:52.865674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:11:52.865674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:11:52.865674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:11:52.865674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:11:52.865674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:11:52.865674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:11:52.865674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:11:52.865674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6OoEetQO9qVaf9gjFrASro6Hd11p_NQuJXB5KwL9ErMYzG6RJSZrEZOkpfBtwuD8Haf0vDWVjgzVNf58A6PplDY-dO1NupWH7ARHRxh7Q-Uwn8qX6-AHdOuvNn1-YdsxPl8VAZx0TsRBoGDbuklgB7f6DIIT-fM8C1znj0N__p3RQYA Aug 02 09:11:52.865674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:11:52.865674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:11:52.865674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:11:52.865674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:11:52.865674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:11:52.865674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:11:52.865674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: 53df83f23dcf439aae2c867c57df57e0 Aug 02 09:11:52.865674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-DeleteServersTestJSON-1769789556 Aug 02 09:11:52.865674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:11:52.865674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:11:52.868250 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53df83f23dcf439aae2c867c57df57e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/53df83f23dcf439aae2c867c57df57e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53df83f23dcf439aae2c867c57df57e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_53df83f23dcf439aae2c867c57df57e0"}]}] Aug 02 09:11:52.868250 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-DeleteServersTestJSON-1769789556 Aug 02 09:11:52.868250 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: 53df83f23dcf439aae2c867c57df57e0 Aug 02 09:11:52.868250 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-DeleteServersTestJSON-1769789556 Aug 02 09:11:52.868250 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-DeleteServersTestJSON-1769789556-project Aug 02 09:11:52.868250 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:11:52.868250 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:11:52.868250 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: ed8d0b552b03417c9db1f5fc2bef05b2 Aug 02 09:11:52.868250 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-DeleteServersTestJSON-1769789556-project Aug 02 09:11:52.868250 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: > Aug 02 09:11:52.868250 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff could not be found. Aug 02 09:11:52.868250 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': 'b99c5502-ef55-4e1e-a47c-c708aaf2b0ff'} Aug 02 09:11:52.869615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:11:52.869615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:11:52.869615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:11:52.869615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:11:52.869615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:11:52.869615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:11:52.869615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:11:52.869615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:11:52.869615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:11:52.869615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:11:52.869615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff could not be found. Aug 02 09:11:52.869615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:11:52.869615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:11:52.869615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:11:52.869615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:11:52.869615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:11:52.869615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:11:52.869615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:11:52.869615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:11:52.869615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:11:52.871884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:11:52.871884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:11:52.871884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:11:52.871884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:11:52.871884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:11:52.871884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:11:52.871884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:11:52.871884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:11:52.871884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:11:52.871884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff could not be found. Aug 02 09:11:52.871884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:11:52.871884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:11:52.871884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:11:52.871884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:11:52.871884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:11:52.871884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:11:52.871884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:11:52.871884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:11:52.871884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff could not be found. Aug 02 09:11:52.871884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:11:52.874253 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-b6b5d496-273c-4109-aafb-42c679e2c71c tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Returning 404 to user: Instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:11:52.874253 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-b6b5d496-273c-4109-aafb-42c679e2c71c tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 404 len: 111 microversion: 2.1 time: 0.056114 Aug 02 09:11:52.874253 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 85/169] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:11:52 2022] DELETE /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:11:52.890323 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-af9504c9-098f-45d4-9de9-e6887e275339 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:52.891351 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-af9504c9-098f-45d4-9de9-e6887e275339 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] [instance: b99c5502-ef55-4e1e-a47c-c708aaf2b0ff] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:52.904860 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-af9504c9-098f-45d4-9de9-e6887e275339 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:52.905541 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-af9504c9-098f-45d4-9de9-e6887e275339 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:52.906809 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-af9504c9-098f-45d4-9de9-e6887e275339 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:52.907584 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-af9504c9-098f-45d4-9de9-e6887e275339 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:52.938201 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-af9504c9-098f-45d4-9de9-e6887e275339 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] HTTP exception thrown: Instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff could not be found. Aug 02 09:11:52.940452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-af9504c9-098f-45d4-9de9-e6887e275339 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Request method failure captured: Aug 02 09:11:52.940452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff HTTP/1.1 Aug 02 09:11:52.940452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:11:52.940452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:11:52.940452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:11:52.940452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:11:52.940452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:11:52.940452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:11:52.940452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:11:52.940452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:11:52.940452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OoEetQO9qVaf9gjFrASro6Hd11p_NQuJXB5KwL9ErMYzG6RJSZrEZOkpfBtwuD8Haf0vDWVjgzVNf58A6PplDY-dO1NupWH7ARHRxh7Q-Uwn8qX6-AHdOuvNn1-YdsxPl8VAZx0TsRBoGDbuklgB7f6DIIT-fM8C1znj0N__p3RQYA Aug 02 09:11:52.940452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:11:52.940452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:11:52.940452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:11:52.940452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:11:52.940452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:11:52.940452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:11:52.940452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: 53df83f23dcf439aae2c867c57df57e0 Aug 02 09:11:52.940452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-DeleteServersTestJSON-1769789556 Aug 02 09:11:52.940452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:11:52.940452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:11:52.942937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53df83f23dcf439aae2c867c57df57e0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/53df83f23dcf439aae2c867c57df57e0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/53df83f23dcf439aae2c867c57df57e0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_53df83f23dcf439aae2c867c57df57e0"}]}] Aug 02 09:11:52.942937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-DeleteServersTestJSON-1769789556 Aug 02 09:11:52.942937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: 53df83f23dcf439aae2c867c57df57e0 Aug 02 09:11:52.942937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-DeleteServersTestJSON-1769789556 Aug 02 09:11:52.942937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-DeleteServersTestJSON-1769789556-project Aug 02 09:11:52.942937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:11:52.942937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:11:52.942937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: ed8d0b552b03417c9db1f5fc2bef05b2 Aug 02 09:11:52.942937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-DeleteServersTestJSON-1769789556-project Aug 02 09:11:52.942937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:11:52.942937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff could not be found. Aug 02 09:11:52.942937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'id': 'b99c5502-ef55-4e1e-a47c-c708aaf2b0ff'} Aug 02 09:11:52.944419 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:11:52.944419 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:11:52.944419 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:11:52.944419 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:11:52.944419 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:11:52.944419 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:11:52.944419 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:11:52.944419 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:11:52.944419 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:11:52.944419 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:11:52.944419 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff could not be found. Aug 02 09:11:52.944419 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:11:52.944419 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:11:52.944419 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:11:52.944419 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:11:52.944419 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:11:52.944419 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:11:52.944419 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:11:52.944419 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:11:52.944419 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:11:52.946765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:11:52.946765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:11:52.946765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:11:52.946765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:11:52.946765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:11:52.946765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:11:52.946765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:11:52.946765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff could not be found. Aug 02 09:11:52.946765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:11:52.946765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:11:52.946765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:11:52.946765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:11:52.946765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:11:52.946765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:11:52.946765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:11:52.946765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:11:52.946765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff could not be found. Aug 02 09:11:52.946765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:11:52.948335 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-af9504c9-098f-45d4-9de9-e6887e275339 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] Returning 404 to user: Instance b99c5502-ef55-4e1e-a47c-c708aaf2b0ff could not be found. {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:11:52.949549 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-af9504c9-098f-45d4-9de9-e6887e275339 tempest-DeleteServersTestJSON-1769789556 tempest-DeleteServersTestJSON-1769789556-project] 10.222.0.20 "GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff" status: 404 len: 111 microversion: 2.1 time: 0.066970 Aug 02 09:11:52.950380 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 85/170] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:52 2022] GET /compute/v2.1/servers/b99c5502-ef55-4e1e-a47c-c708aaf2b0ff => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:11:53.547376 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-e40cacdb-576a-4099-bde4-19f26897cf31 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:53.547376 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-e40cacdb-576a-4099-bde4-19f26897cf31 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:53.565385 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e40cacdb-576a-4099-bde4-19f26897cf31 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:53.565841 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e40cacdb-576a-4099-bde4-19f26897cf31 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:53.568797 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e40cacdb-576a-4099-bde4-19f26897cf31 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:53.569297 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e40cacdb-576a-4099-bde4-19f26897cf31 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:53.937046 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-e40cacdb-576a-4099-bde4-19f26897cf31 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:53.947634 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-e40cacdb-576a-4099-bde4-19f26897cf31 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.405642 Aug 02 09:11:53.948723 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 86/171] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:53 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:54.989317 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-df6d4d19-e2b8-4c9a-98ac-b6e9af979f7d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:54.993280 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-df6d4d19-e2b8-4c9a-98ac-b6e9af979f7d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:55.005484 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-df6d4d19-e2b8-4c9a-98ac-b6e9af979f7d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:55.006356 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-df6d4d19-e2b8-4c9a-98ac-b6e9af979f7d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:55.007714 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-df6d4d19-e2b8-4c9a-98ac-b6e9af979f7d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:55.008242 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-df6d4d19-e2b8-4c9a-98ac-b6e9af979f7d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:55.414794 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-df6d4d19-e2b8-4c9a-98ac-b6e9af979f7d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:55.450762 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-df6d4d19-e2b8-4c9a-98ac-b6e9af979f7d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.470856 Aug 02 09:11:55.451802 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 86/172] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:54 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:56.507057 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-0e4da466-cb37-453a-9f02-10276b75bcf1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:56.515465 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-0e4da466-cb37-453a-9f02-10276b75bcf1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:56.542261 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0e4da466-cb37-453a-9f02-10276b75bcf1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:56.543502 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0e4da466-cb37-453a-9f02-10276b75bcf1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:56.549590 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0e4da466-cb37-453a-9f02-10276b75bcf1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:56.550751 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0e4da466-cb37-453a-9f02-10276b75bcf1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:56.990238 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-0e4da466-cb37-453a-9f02-10276b75bcf1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:57.010338 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-0e4da466-cb37-453a-9f02-10276b75bcf1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.510369 Aug 02 09:11:57.012137 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 87/173] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:56 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:11:58.034623 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-e0573bb1-3997-4c07-bf0c-09af826b346c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:58.035948 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-e0573bb1-3997-4c07-bf0c-09af826b346c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:58.038358 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:11:58.046780 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e0573bb1-3997-4c07-bf0c-09af826b346c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:58.047711 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e0573bb1-3997-4c07-bf0c-09af826b346c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:58.049436 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e0573bb1-3997-4c07-bf0c-09af826b346c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:58.050524 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e0573bb1-3997-4c07-bf0c-09af826b346c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:58.298046 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-e0573bb1-3997-4c07-bf0c-09af826b346c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:58.307467 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-e0573bb1-3997-4c07-bf0c-09af826b346c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.276770 Aug 02 09:11:58.315082 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 87/174] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:58 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:11:59.344333 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4a7133ff-5c62-4add-950b-96246ee176d2 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:11:59.348834 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-4a7133ff-5c62-4add-950b-96246ee176d2 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:11:59.383929 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4a7133ff-5c62-4add-950b-96246ee176d2 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:59.385259 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4a7133ff-5c62-4add-950b-96246ee176d2 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:59.387077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4a7133ff-5c62-4add-950b-96246ee176d2 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:11:59.388074 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4a7133ff-5c62-4add-950b-96246ee176d2 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:11:59.911502 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-4a7133ff-5c62-4add-950b-96246ee176d2 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:11:59.931201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-4a7133ff-5c62-4add-950b-96246ee176d2 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.597558 Aug 02 09:11:59.933572 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 88/175] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:11:59 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:00.974090 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b67686c6-c40d-4969-97dc-76016fcf07be tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:00.975261 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b67686c6-c40d-4969-97dc-76016fcf07be tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:00.988999 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b67686c6-c40d-4969-97dc-76016fcf07be tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:00.989972 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b67686c6-c40d-4969-97dc-76016fcf07be tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:00.991179 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b67686c6-c40d-4969-97dc-76016fcf07be tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:00.992266 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b67686c6-c40d-4969-97dc-76016fcf07be tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:01.270646 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b67686c6-c40d-4969-97dc-76016fcf07be tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:01.279838 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b67686c6-c40d-4969-97dc-76016fcf07be tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.317586 Aug 02 09:12:01.280378 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 88/176] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:00 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:02.307229 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-15845fdb-c5ec-4504-bbfc-3e4d12fcdeaf tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:02.308744 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-15845fdb-c5ec-4504-bbfc-3e4d12fcdeaf tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:02.319598 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-15845fdb-c5ec-4504-bbfc-3e4d12fcdeaf tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:02.321141 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-15845fdb-c5ec-4504-bbfc-3e4d12fcdeaf tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:02.322329 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-15845fdb-c5ec-4504-bbfc-3e4d12fcdeaf tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:02.323031 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-15845fdb-c5ec-4504-bbfc-3e4d12fcdeaf tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:02.560938 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-15845fdb-c5ec-4504-bbfc-3e4d12fcdeaf tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:02.584462 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-15845fdb-c5ec-4504-bbfc-3e4d12fcdeaf tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.277588 Aug 02 09:12:02.587636 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 89/177] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:02 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:03.626299 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-42f7a93b-4a2d-4c95-b209-f2a7a62f7158 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:03.628001 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-42f7a93b-4a2d-4c95-b209-f2a7a62f7158 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:03.638238 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-42f7a93b-4a2d-4c95-b209-f2a7a62f7158 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:03.638687 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-42f7a93b-4a2d-4c95-b209-f2a7a62f7158 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:03.639485 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-42f7a93b-4a2d-4c95-b209-f2a7a62f7158 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:03.639922 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-42f7a93b-4a2d-4c95-b209-f2a7a62f7158 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:03.849808 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-42f7a93b-4a2d-4c95-b209-f2a7a62f7158 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:03.859792 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-42f7a93b-4a2d-4c95-b209-f2a7a62f7158 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.241442 Aug 02 09:12:03.860417 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 89/178] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:03 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:04.883876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ff667437-c702-40e5-8c97-f86ba820e401 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:04.884623 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ff667437-c702-40e5-8c97-f86ba820e401 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:04.897341 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ff667437-c702-40e5-8c97-f86ba820e401 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:04.897920 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ff667437-c702-40e5-8c97-f86ba820e401 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:04.902526 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ff667437-c702-40e5-8c97-f86ba820e401 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:04.902526 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ff667437-c702-40e5-8c97-f86ba820e401 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:05.251261 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ff667437-c702-40e5-8c97-f86ba820e401 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:05.264306 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ff667437-c702-40e5-8c97-f86ba820e401 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.385769 Aug 02 09:12:05.268304 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 90/179] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:04 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:06.317668 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-bc1d7f3e-ccae-4244-9e5d-a435165eeedd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:06.317668 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-bc1d7f3e-ccae-4244-9e5d-a435165eeedd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:06.321438 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bc1d7f3e-ccae-4244-9e5d-a435165eeedd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:06.326473 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bc1d7f3e-ccae-4244-9e5d-a435165eeedd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:06.326473 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bc1d7f3e-ccae-4244-9e5d-a435165eeedd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:06.326473 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bc1d7f3e-ccae-4244-9e5d-a435165eeedd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:06.686975 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-bc1d7f3e-ccae-4244-9e5d-a435165eeedd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:06.740062 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-bc1d7f3e-ccae-4244-9e5d-a435165eeedd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.429770 Aug 02 09:12:06.740062 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 90/180] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:06 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:07.772485 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-aa3fd39c-606d-4a77-bf76-e40072a1ccb4 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:07.773239 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-aa3fd39c-606d-4a77-bf76-e40072a1ccb4 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:07.784140 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=34 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:07.788538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-aa3fd39c-606d-4a77-bf76-e40072a1ccb4 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:07.789043 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-aa3fd39c-606d-4a77-bf76-e40072a1ccb4 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:07.789973 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-aa3fd39c-606d-4a77-bf76-e40072a1ccb4 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:07.790522 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-aa3fd39c-606d-4a77-bf76-e40072a1ccb4 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:08.148455 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-aa3fd39c-606d-4a77-bf76-e40072a1ccb4 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:08.180246 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-aa3fd39c-606d-4a77-bf76-e40072a1ccb4 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.410501 Aug 02 09:12:08.186628 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 91/181] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:07 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:09.233193 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-88706cfa-ffc7-46ea-b801-c7d3ffb8e21d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:09.235516 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-88706cfa-ffc7-46ea-b801-c7d3ffb8e21d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:09.246937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-88706cfa-ffc7-46ea-b801-c7d3ffb8e21d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:09.248389 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-88706cfa-ffc7-46ea-b801-c7d3ffb8e21d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:09.251276 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-88706cfa-ffc7-46ea-b801-c7d3ffb8e21d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:09.252787 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-88706cfa-ffc7-46ea-b801-c7d3ffb8e21d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:09.643789 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-88706cfa-ffc7-46ea-b801-c7d3ffb8e21d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:09.655355 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-88706cfa-ffc7-46ea-b801-c7d3ffb8e21d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.430727 Aug 02 09:12:09.656271 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 91/182] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:09 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:10.708822 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-1bae04ff-521e-4df8-9346-2c5fb7d3df75 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:10.713957 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-1bae04ff-521e-4df8-9346-2c5fb7d3df75 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:10.743273 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1bae04ff-521e-4df8-9346-2c5fb7d3df75 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:10.745246 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1bae04ff-521e-4df8-9346-2c5fb7d3df75 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:10.746624 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1bae04ff-521e-4df8-9346-2c5fb7d3df75 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:10.749618 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1bae04ff-521e-4df8-9346-2c5fb7d3df75 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:11.046384 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-1bae04ff-521e-4df8-9346-2c5fb7d3df75 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:11.056640 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-1bae04ff-521e-4df8-9346-2c5fb7d3df75 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.362888 Aug 02 09:12:11.057749 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 92/183] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:10 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:12.095457 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-f0123c68-f151-477c-9d96-4887a15990c6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:12.096975 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-f0123c68-f151-477c-9d96-4887a15990c6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:12.106444 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f0123c68-f151-477c-9d96-4887a15990c6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:12.107257 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f0123c68-f151-477c-9d96-4887a15990c6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:12.108300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f0123c68-f151-477c-9d96-4887a15990c6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:12.109565 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f0123c68-f151-477c-9d96-4887a15990c6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:12.400777 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-f0123c68-f151-477c-9d96-4887a15990c6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:12.436996 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-f0123c68-f151-477c-9d96-4887a15990c6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.340981 Aug 02 09:12:12.436996 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 92/184] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:12 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:13.171512 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-8532164f-1ff5-46c0-9cca-b42a95aa648a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Action: 'create', calling method: .version_select at 0x7ffb9acc8e50>, body: {"keypair": {"name": "tempest-keypair-1690372796", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNv9sIf9ERBEtTHO3Td8W8vKsg5N4j0ZVt9oz6DqfhtPLMDBWu/druwXQrJi/bhl1gGw/Ap04KCzgzF/hst0G8Df9sr/fqR//yAjUcvHc78UyzYAENuBRwfkNE857qQLng=="}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:13.224278 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-8532164f-1ff5-46c0-9cca-b42a95aa648a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Getting quotas for project 696f75fb6c494cfab9deb3d36c3ad599. Resources: {'key_pairs'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:12:13.245991 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-8532164f-1ff5-46c0-9cca-b42a95aa648a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Getting quotas for user 3bccd348dd13473e82ca33c42b840383 and project 696f75fb6c494cfab9deb3d36c3ad599. Resources: {'key_pairs'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:12:13.404966 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-8532164f-1ff5-46c0-9cca-b42a95aa648a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.568563 Aug 02 09:12:13.407473 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 93/185] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 2 09:12:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:12:13.464282 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-1149f229-4ee7-4f24-9b92-5906e37d9721 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:13.465724 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-1149f229-4ee7-4f24-9b92-5906e37d9721 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:13.477597 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1149f229-4ee7-4f24-9b92-5906e37d9721 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:13.478381 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1149f229-4ee7-4f24-9b92-5906e37d9721 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:13.479838 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1149f229-4ee7-4f24-9b92-5906e37d9721 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:13.480703 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1149f229-4ee7-4f24-9b92-5906e37d9721 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:13.763636 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-1149f229-4ee7-4f24-9b92-5906e37d9721 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:13.774338 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-1149f229-4ee7-4f24-9b92-5906e37d9721 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.319141 Aug 02 09:12:13.774949 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 93/186] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:13 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:14.802673 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-22641846-8c92-441c-b8af-c7dd4ba94c71 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:14.803853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-22641846-8c92-441c-b8af-c7dd4ba94c71 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:14.822096 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-22641846-8c92-441c-b8af-c7dd4ba94c71 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:14.824101 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-22641846-8c92-441c-b8af-c7dd4ba94c71 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:14.826078 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-22641846-8c92-441c-b8af-c7dd4ba94c71 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:14.827517 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-22641846-8c92-441c-b8af-c7dd4ba94c71 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:15.098785 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-22641846-8c92-441c-b8af-c7dd4ba94c71 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:15.114916 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-22641846-8c92-441c-b8af-c7dd4ba94c71 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1522 microversion: 2.1 time: 0.320905 Aug 02 09:12:15.116847 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 94/187] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:14 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:16.149309 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-d55ce256-53e2-4f68-9fb2-c4b34731b106 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:16.155981 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-d55ce256-53e2-4f68-9fb2-c4b34731b106 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:16.158982 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d55ce256-53e2-4f68-9fb2-c4b34731b106 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:16.159549 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d55ce256-53e2-4f68-9fb2-c4b34731b106 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:16.161179 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d55ce256-53e2-4f68-9fb2-c4b34731b106 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:16.161629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d55ce256-53e2-4f68-9fb2-c4b34731b106 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:16.165938 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=86 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:16.557158 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-d55ce256-53e2-4f68-9fb2-c4b34731b106 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:16.592251 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-d55ce256-53e2-4f68-9fb2-c4b34731b106 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1502 microversion: 2.1 time: 0.448965 Aug 02 09:12:16.601092 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 94/188] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:16 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1502 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:16.641804 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-1f22fb65-0502-4938-ba83-59d663cc81d4 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:16.646855 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-1f22fb65-0502-4938-ba83-59d663cc81d4 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:16.672012 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1f22fb65-0502-4938-ba83-59d663cc81d4 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:16.673122 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1f22fb65-0502-4938-ba83-59d663cc81d4 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:16.674898 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1f22fb65-0502-4938-ba83-59d663cc81d4 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:16.679455 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1f22fb65-0502-4938-ba83-59d663cc81d4 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:17.027739 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-1f22fb65-0502-4938-ba83-59d663cc81d4 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:17.047940 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-1f22fb65-0502-4938-ba83-59d663cc81d4 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1515 microversion: 2.1 time: 0.415254 Aug 02 09:12:17.055747 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 95/189] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:16 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1515 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:18.066802 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-010d33e1-5ee7-49df-be8a-dbbf9eed8eea tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-395841279", "imageRef": "7a52f4c5-c531-494a-b375-4f6dce3abbc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab237ada-006b-4bfa-8c12-da09c8cbc0dd"}], "security_groups": [{"name": "tempest-securitygroup--999867916"}], "key_name": "tempest-keypair-1690372796", "user_data": "}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:18.256809 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.network.neutron [None req-010d33e1-5ee7-49df-be8a-dbbf9eed8eea tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] validate_networks() for [('ab237ada-006b-4bfa-8c12-da09c8cbc0dd', None, None, None, None, None)] {{(pid=118526) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:12:18.859737 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-010d33e1-5ee7-49df-be8a-dbbf9eed8eea tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Flavor limits 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:12:18.860383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-010d33e1-5ee7-49df-be8a-dbbf9eed8eea tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Image limits 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:12:18.860810 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-010d33e1-5ee7-49df-be8a-dbbf9eed8eea tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Flavor pref 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:12:18.861227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-010d33e1-5ee7-49df-be8a-dbbf9eed8eea tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Image pref 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:12:18.861669 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-010d33e1-5ee7-49df-be8a-dbbf9eed8eea tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:12:18.875894 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-010d33e1-5ee7-49df-be8a-dbbf9eed8eea tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:18.875894 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-010d33e1-5ee7-49df-be8a-dbbf9eed8eea tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:18.876624 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-010d33e1-5ee7-49df-be8a-dbbf9eed8eea tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:18.877156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-010d33e1-5ee7-49df-be8a-dbbf9eed8eea tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:18.899939 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-010d33e1-5ee7-49df-be8a-dbbf9eed8eea tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Getting quotas for project 696f75fb6c494cfab9deb3d36c3ad599. Resources: {'cores', 'ram', 'instances'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:12:18.904493 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-010d33e1-5ee7-49df-be8a-dbbf9eed8eea tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Getting quotas for user 3bccd348dd13473e82ca33c42b840383 and project 696f75fb6c494cfab9deb3d36c3ad599. Resources: {'cores', 'ram', 'instances'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:12:18.918969 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-010d33e1-5ee7-49df-be8a-dbbf9eed8eea tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Going to run 1 instances... {{(pid=118526) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:12:18.920960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-010d33e1-5ee7-49df-be8a-dbbf9eed8eea tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7a52f4c5-c531-494a-b375-4f6dce3abbc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:12:19.163113 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-010d33e1-5ee7-49df-be8a-dbbf9eed8eea tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.102048 Aug 02 09:12:19.165031 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 95/190] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 2 09:12:18 2022] POST /compute/v2.1/servers => generated 401 bytes in 1104 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:12:19.193458 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-b7dfcb48-35da-44a4-8102-6b85056a8302 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:19.193458 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-b7dfcb48-35da-44a4-8102-6b85056a8302 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:19.315388 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-b7dfcb48-35da-44a4-8102-6b85056a8302 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:19.332246 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-b7dfcb48-35da-44a4-8102-6b85056a8302 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1237 microversion: 2.1 time: 0.148954 Aug 02 09:12:19.335132 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 96/191] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:19 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1237 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:19.475878 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-0086b81a-551d-4097-a921-643b67520d25 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:19.480475 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-0086b81a-551d-4097-a921-643b67520d25 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:19.493850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0086b81a-551d-4097-a921-643b67520d25 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:19.494652 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0086b81a-551d-4097-a921-643b67520d25 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:19.496188 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0086b81a-551d-4097-a921-643b67520d25 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:19.496880 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0086b81a-551d-4097-a921-643b67520d25 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:19.543897 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.objects.instance [None req-0086b81a-551d-4097-a921-643b67520d25 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lazy-loading 'flavor' on Instance uuid 44854eb9-caa3-4fc7-bd14-6a150fcafcd3 {{(pid=118526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:12:20.072213 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-0086b81a-551d-4097-a921-643b67520d25 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "POST /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3/action" status: 200 len: 32 microversion: 2.1 time: 0.605026 Aug 02 09:12:20.092468 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ec47a0cd-afd4-4c36-8484-8f07dfb11859 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:20.093251 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 96/192] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 2 09:12:19 2022] POST /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3/action => generated 32 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:12:20.095122 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ec47a0cd-afd4-4c36-8484-8f07dfb11859 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:20.107539 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ec47a0cd-afd4-4c36-8484-8f07dfb11859 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:20.116022 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ec47a0cd-afd4-4c36-8484-8f07dfb11859 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:20.116022 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ec47a0cd-afd4-4c36-8484-8f07dfb11859 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:20.116022 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ec47a0cd-afd4-4c36-8484-8f07dfb11859 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:20.365346 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-bff67dc0-046d-4e9d-8815-7d88db998df9 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:20.371218 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-bff67dc0-046d-4e9d-8815-7d88db998df9 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:20.441436 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ec47a0cd-afd4-4c36-8484-8f07dfb11859 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:20.458954 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ec47a0cd-afd4-4c36-8484-8f07dfb11859 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1521 microversion: 2.1 time: 0.374696 Aug 02 09:12:20.460648 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 97/193] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:20 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1521 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:20.510250 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-bff67dc0-046d-4e9d-8815-7d88db998df9 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:20.531752 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-bff67dc0-046d-4e9d-8815-7d88db998df9 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1237 microversion: 2.1 time: 0.177466 Aug 02 09:12:20.533319 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 97/194] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:20 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1237 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:21.488366 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-a4377779-2bc2-438b-8587-817217b3cdbb tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:21.489738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-a4377779-2bc2-438b-8587-817217b3cdbb tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:21.497940 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a4377779-2bc2-438b-8587-817217b3cdbb tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:21.498382 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a4377779-2bc2-438b-8587-817217b3cdbb tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:21.499174 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a4377779-2bc2-438b-8587-817217b3cdbb tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:21.499722 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a4377779-2bc2-438b-8587-817217b3cdbb tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:21.566823 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-6879709c-6172-4644-ae92-af1a529377ea tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:21.567989 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-6879709c-6172-4644-ae92-af1a529377ea tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:21.583364 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6879709c-6172-4644-ae92-af1a529377ea tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:21.584601 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6879709c-6172-4644-ae92-af1a529377ea tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:21.586172 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6879709c-6172-4644-ae92-af1a529377ea tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:21.587684 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6879709c-6172-4644-ae92-af1a529377ea tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:21.739620 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-6879709c-6172-4644-ae92-af1a529377ea tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:21.754516 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-6879709c-6172-4644-ae92-af1a529377ea tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1233 microversion: 2.1 time: 0.193298 Aug 02 09:12:21.764262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 98/195] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:21 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1233 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:21.819657 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-a4377779-2bc2-438b-8587-817217b3cdbb tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:21.836489 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-a4377779-2bc2-438b-8587-817217b3cdbb tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1521 microversion: 2.1 time: 0.354007 Aug 02 09:12:21.838434 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 98/196] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:21 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1521 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:22.792998 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-bff4a35e-0b40-4f5f-8811-7942f2fb049d tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:22.802091 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-bff4a35e-0b40-4f5f-8811-7942f2fb049d tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:22.805709 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bff4a35e-0b40-4f5f-8811-7942f2fb049d tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:22.806965 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bff4a35e-0b40-4f5f-8811-7942f2fb049d tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:22.808348 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bff4a35e-0b40-4f5f-8811-7942f2fb049d tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:22.809371 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bff4a35e-0b40-4f5f-8811-7942f2fb049d tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:22.878788 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-da6f2b56-617f-45c6-b923-095a92dbe8c9 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:22.887811 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-da6f2b56-617f-45c6-b923-095a92dbe8c9 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:22.899512 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-da6f2b56-617f-45c6-b923-095a92dbe8c9 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:22.900991 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-da6f2b56-617f-45c6-b923-095a92dbe8c9 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:22.903198 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-da6f2b56-617f-45c6-b923-095a92dbe8c9 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:22.904476 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-da6f2b56-617f-45c6-b923-095a92dbe8c9 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:22.916704 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=70 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:22.995215 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-bff4a35e-0b40-4f5f-8811-7942f2fb049d tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:23.014383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-bff4a35e-0b40-4f5f-8811-7942f2fb049d tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1297 microversion: 2.1 time: 0.223316 Aug 02 09:12:23.021654 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 99/197] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:22 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1297 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:23.331165 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-da6f2b56-617f-45c6-b923-095a92dbe8c9 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:23.348022 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-da6f2b56-617f-45c6-b923-095a92dbe8c9 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1521 microversion: 2.1 time: 0.480667 Aug 02 09:12:23.358844 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 99/198] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:22 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1521 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:24.084561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b425aa76-5147-4c3c-8906-70bd0fc691d6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:24.086828 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b425aa76-5147-4c3c-8906-70bd0fc691d6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:24.095455 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b425aa76-5147-4c3c-8906-70bd0fc691d6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:24.096728 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b425aa76-5147-4c3c-8906-70bd0fc691d6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:24.100583 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b425aa76-5147-4c3c-8906-70bd0fc691d6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:24.101797 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b425aa76-5147-4c3c-8906-70bd0fc691d6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:24.223282 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b425aa76-5147-4c3c-8906-70bd0fc691d6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:24.242774 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b425aa76-5147-4c3c-8906-70bd0fc691d6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1295 microversion: 2.1 time: 0.170152 Aug 02 09:12:24.244875 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 100/199] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:24 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1295 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:24.408620 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d7dd4942-21dc-4f80-88f3-0fbbf35c33db tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:24.411423 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-d7dd4942-21dc-4f80-88f3-0fbbf35c33db tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:24.445522 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d7dd4942-21dc-4f80-88f3-0fbbf35c33db tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:24.445522 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d7dd4942-21dc-4f80-88f3-0fbbf35c33db tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:24.445522 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d7dd4942-21dc-4f80-88f3-0fbbf35c33db tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:24.445522 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d7dd4942-21dc-4f80-88f3-0fbbf35c33db tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:24.888753 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d7dd4942-21dc-4f80-88f3-0fbbf35c33db tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:24.898791 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-d7dd4942-21dc-4f80-88f3-0fbbf35c33db tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1521 microversion: 2.1 time: 0.506227 Aug 02 09:12:24.899380 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 100/200] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:24 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1521 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:25.274563 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-7bcbb96d-492e-4b16-8407-f8a2f485bb6f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:25.275976 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-7bcbb96d-492e-4b16-8407-f8a2f485bb6f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:25.289598 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7bcbb96d-492e-4b16-8407-f8a2f485bb6f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:25.291531 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7bcbb96d-492e-4b16-8407-f8a2f485bb6f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:25.293726 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7bcbb96d-492e-4b16-8407-f8a2f485bb6f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:25.295148 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7bcbb96d-492e-4b16-8407-f8a2f485bb6f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:25.557173 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-7bcbb96d-492e-4b16-8407-f8a2f485bb6f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:25.569845 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-7bcbb96d-492e-4b16-8407-f8a2f485bb6f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1362 microversion: 2.1 time: 0.304561 Aug 02 09:12:25.584499 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 101/201] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:25 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:25.926516 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-064528d8-47c3-44e2-859b-0d0207218998 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:25.931033 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-064528d8-47c3-44e2-859b-0d0207218998 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:25.939328 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-064528d8-47c3-44e2-859b-0d0207218998 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:25.940077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-064528d8-47c3-44e2-859b-0d0207218998 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:25.941957 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-064528d8-47c3-44e2-859b-0d0207218998 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:25.942664 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-064528d8-47c3-44e2-859b-0d0207218998 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:26.173746 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-064528d8-47c3-44e2-859b-0d0207218998 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:26.186591 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-064528d8-47c3-44e2-859b-0d0207218998 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1521 microversion: 2.1 time: 0.268360 Aug 02 09:12:26.187733 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 101/202] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:25 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:26.392999 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-e84523cb-9ab7-4e67-8f6a-8244e0917c7a req-f6e6f7d0-d32e-4c70-8845-3cd260d73d81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73c852c4-c5c3-4a1f-94b9-f6515a830bbb", "tag": "d833b29e-12d4-4f6f-b2fe-e1239d280814"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:26.414180 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-e84523cb-9ab7-4e67-8f6a-8244e0917c7a req-f6e6f7d0-d32e-4c70-8845-3cd260d73d81 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:26.415382 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-e84523cb-9ab7-4e67-8f6a-8244e0917c7a req-f6e6f7d0-d32e-4c70-8845-3cd260d73d81 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:26.446874 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-e84523cb-9ab7-4e67-8f6a-8244e0917c7a req-f6e6f7d0-d32e-4c70-8845-3cd260d73d81 service nova] Creating event network-changed:d833b29e-12d4-4f6f-b2fe-e1239d280814 for instance 73c852c4-c5c3-4a1f-94b9-f6515a830bbb on hv-cinder-84599 Aug 02 09:12:26.450360 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-e84523cb-9ab7-4e67-8f6a-8244e0917c7a req-f6e6f7d0-d32e-4c70-8845-3cd260d73d81 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063959 Aug 02 09:12:26.451897 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 102/203] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:12:26.608615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-00032a45-fa64-4ecb-b808-17fc2dc1e4de tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:26.610922 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-00032a45-fa64-4ecb-b808-17fc2dc1e4de tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:26.627047 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-00032a45-fa64-4ecb-b808-17fc2dc1e4de tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:26.630570 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-00032a45-fa64-4ecb-b808-17fc2dc1e4de tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:26.634909 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-00032a45-fa64-4ecb-b808-17fc2dc1e4de tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:26.634909 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-00032a45-fa64-4ecb-b808-17fc2dc1e4de tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:27.052989 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-00032a45-fa64-4ecb-b808-17fc2dc1e4de tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:27.068979 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-00032a45-fa64-4ecb-b808-17fc2dc1e4de tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1362 microversion: 2.1 time: 0.469754 Aug 02 09:12:27.070965 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 102/204] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:26 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1362 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:27.233520 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-18a9b2ba-6ef7-404e-a92d-4dd711df563a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:27.235009 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-18a9b2ba-6ef7-404e-a92d-4dd711df563a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:27.251665 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-18a9b2ba-6ef7-404e-a92d-4dd711df563a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:27.252630 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-18a9b2ba-6ef7-404e-a92d-4dd711df563a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:27.254289 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-18a9b2ba-6ef7-404e-a92d-4dd711df563a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:27.256122 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-18a9b2ba-6ef7-404e-a92d-4dd711df563a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:27.803822 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-18a9b2ba-6ef7-404e-a92d-4dd711df563a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:27.815767 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-18a9b2ba-6ef7-404e-a92d-4dd711df563a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1521 microversion: 2.1 time: 0.592433 Aug 02 09:12:27.821627 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 103/205] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:27 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1521 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:28.133820 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-c331ec1a-dfcc-492e-b9f3-d4499f4fa1ac tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:28.135955 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-c331ec1a-dfcc-492e-b9f3-d4499f4fa1ac tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:28.150627 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c331ec1a-dfcc-492e-b9f3-d4499f4fa1ac tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:28.151862 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c331ec1a-dfcc-492e-b9f3-d4499f4fa1ac tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:28.155019 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c331ec1a-dfcc-492e-b9f3-d4499f4fa1ac tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:28.156347 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c331ec1a-dfcc-492e-b9f3-d4499f4fa1ac tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:28.554625 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-c331ec1a-dfcc-492e-b9f3-d4499f4fa1ac tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:28.574119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-c331ec1a-dfcc-492e-b9f3-d4499f4fa1ac tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1362 microversion: 2.1 time: 0.462485 Aug 02 09:12:28.580109 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 103/206] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:28 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1362 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:28.852894 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-85a96fa1-744d-4f92-a084-830fe0971750 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:28.854034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-85a96fa1-744d-4f92-a084-830fe0971750 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:28.859762 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:28.868055 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-85a96fa1-744d-4f92-a084-830fe0971750 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:28.869075 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-85a96fa1-744d-4f92-a084-830fe0971750 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:28.870514 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-85a96fa1-744d-4f92-a084-830fe0971750 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:28.871295 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-85a96fa1-744d-4f92-a084-830fe0971750 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:28.899808 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=2 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:29.146198 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-67976925-341e-4f89-a981-8038fb2597ec tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:29.150305 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-67976925-341e-4f89-a981-8038fb2597ec tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:29.164262 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-67976925-341e-4f89-a981-8038fb2597ec tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:29.165632 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-67976925-341e-4f89-a981-8038fb2597ec tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:29.167640 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-67976925-341e-4f89-a981-8038fb2597ec tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:29.169107 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-67976925-341e-4f89-a981-8038fb2597ec tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:29.295117 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-67976925-341e-4f89-a981-8038fb2597ec tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7/ips" status: 200 len: 150 microversion: 2.1 time: 0.169013 Aug 02 09:12:29.320371 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 104/207] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 2 09:12:29 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7/ips => generated 150 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:12:29.341209 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-191051e9-df43-4afe-960e-37cb38124b49 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:29.343153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-191051e9-df43-4afe-960e-37cb38124b49 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:29.350876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=6 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:29.365441 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-191051e9-df43-4afe-960e-37cb38124b49 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:29.366594 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-191051e9-df43-4afe-960e-37cb38124b49 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:29.368339 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-191051e9-df43-4afe-960e-37cb38124b49 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:29.369468 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-191051e9-df43-4afe-960e-37cb38124b49 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:29.504422 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-191051e9-df43-4afe-960e-37cb38124b49 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27/ips" status: 200 len: 152 microversion: 2.20 time: 0.170708 Aug 02 09:12:29.511235 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 105/208] 10.222.0.20 () {60 vars in 1289 bytes} [Tue Aug 2 09:12:29 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27/ips => generated 152 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:12:29.603795 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d93c8d14-bf09-4920-9439-80de3bf57e88 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:29.609030 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-d93c8d14-bf09-4920-9439-80de3bf57e88 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:29.633533 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d93c8d14-bf09-4920-9439-80de3bf57e88 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:29.639911 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d93c8d14-bf09-4920-9439-80de3bf57e88 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:29.641147 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d93c8d14-bf09-4920-9439-80de3bf57e88 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:29.641799 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d93c8d14-bf09-4920-9439-80de3bf57e88 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:30.113589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-85a96fa1-744d-4f92-a084-830fe0971750 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:30.147114 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-85a96fa1-744d-4f92-a084-830fe0971750 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1521 microversion: 2.1 time: 1.308787 Aug 02 09:12:30.181235 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 104/209] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:28 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1521 bytes in 1346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:30.340697 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d93c8d14-bf09-4920-9439-80de3bf57e88 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:30.360320 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-d93c8d14-bf09-4920-9439-80de3bf57e88 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1362 microversion: 2.1 time: 0.764524 Aug 02 09:12:30.363564 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 106/210] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:29 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1362 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:31.197772 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-bc3747c9-9740-44e4-a588-1ede2a335595 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:31.198800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-bc3747c9-9740-44e4-a588-1ede2a335595 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:31.207224 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=8 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:31.247113 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bc3747c9-9740-44e4-a588-1ede2a335595 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:31.247673 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bc3747c9-9740-44e4-a588-1ede2a335595 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:31.248860 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bc3747c9-9740-44e4-a588-1ede2a335595 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:31.254503 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bc3747c9-9740-44e4-a588-1ede2a335595 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:31.394834 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-9b2a6474-101e-4fcb-939c-8a3c1e1fb86a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:31.397812 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-9b2a6474-101e-4fcb-939c-8a3c1e1fb86a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:31.409467 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9b2a6474-101e-4fcb-939c-8a3c1e1fb86a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:31.410765 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9b2a6474-101e-4fcb-939c-8a3c1e1fb86a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:31.412265 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9b2a6474-101e-4fcb-939c-8a3c1e1fb86a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:31.413119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9b2a6474-101e-4fcb-939c-8a3c1e1fb86a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:31.709251 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-bc3747c9-9740-44e4-a588-1ede2a335595 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:31.710966 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-bc3747c9-9740-44e4-a588-1ede2a335595 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1521 microversion: 2.1 time: 0.522442 Aug 02 09:12:31.711656 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 105/211] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:31 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1521 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:31.802136 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-9b2a6474-101e-4fcb-939c-8a3c1e1fb86a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:31.811200 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-9b2a6474-101e-4fcb-939c-8a3c1e1fb86a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1362 microversion: 2.1 time: 0.421051 Aug 02 09:12:31.811781 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 107/212] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:31 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1362 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:32.431666 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-120bc6d6-152f-4882-9232-da5cbe1d1a30 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af5baf2b-ec12-456c-8e83-19abd75a709b"}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:32.439404 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-120bc6d6-152f-4882-9232-da5cbe1d1a30 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:32.475451 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-120bc6d6-152f-4882-9232-da5cbe1d1a30 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:32.476988 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-120bc6d6-152f-4882-9232-da5cbe1d1a30 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:32.481785 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-120bc6d6-152f-4882-9232-da5cbe1d1a30 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:32.483234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-120bc6d6-152f-4882-9232-da5cbe1d1a30 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:32.739580 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-65af204e-b92d-4183-92a8-7c7f5e819dbe tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:32.741458 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-65af204e-b92d-4183-92a8-7c7f5e819dbe tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:32.762851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-65af204e-b92d-4183-92a8-7c7f5e819dbe tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:32.767881 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-65af204e-b92d-4183-92a8-7c7f5e819dbe tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:32.770214 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-65af204e-b92d-4183-92a8-7c7f5e819dbe tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:32.773340 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-65af204e-b92d-4183-92a8-7c7f5e819dbe tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:33.359361 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-65af204e-b92d-4183-92a8-7c7f5e819dbe tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:33.382784 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-65af204e-b92d-4183-92a8-7c7f5e819dbe tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1521 microversion: 2.1 time: 0.650840 Aug 02 09:12:33.395351 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 108/213] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:32 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1521 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:33.419657 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-b9c1e853-cf93-4b3c-b3c8-96a3ee7fd811 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:33.420897 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-b9c1e853-cf93-4b3c-b3c8-96a3ee7fd811 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:33.453433 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b9c1e853-cf93-4b3c-b3c8-96a3ee7fd811 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:33.461903 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b9c1e853-cf93-4b3c-b3c8-96a3ee7fd811 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:33.463938 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b9c1e853-cf93-4b3c-b3c8-96a3ee7fd811 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:33.465138 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b9c1e853-cf93-4b3c-b3c8-96a3ee7fd811 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:33.910829 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-b9c1e853-cf93-4b3c-b3c8-96a3ee7fd811 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:33.938994 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-b9c1e853-cf93-4b3c-b3c8-96a3ee7fd811 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1362 microversion: 2.1 time: 0.528446 Aug 02 09:12:33.943785 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 109/214] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:33 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1362 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:33.967055 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-5657c727-e02c-4763-ac29-476eb1204031 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:33.969348 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-5657c727-e02c-4763-ac29-476eb1204031 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:33.979663 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5657c727-e02c-4763-ac29-476eb1204031 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:33.982123 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5657c727-e02c-4763-ac29-476eb1204031 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:33.982123 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5657c727-e02c-4763-ac29-476eb1204031 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:33.982485 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5657c727-e02c-4763-ac29-476eb1204031 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:34.013748 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-120bc6d6-152f-4882-9232-da5cbe1d1a30 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "POST /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.593112 Aug 02 09:12:34.019801 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 106/215] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 2 09:12:32 2022] POST /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7/os-volume_attachments => generated 194 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:12:34.034185 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.objects.instance [None req-5657c727-e02c-4763-ac29-476eb1204031 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lazy-loading 'flavor' on Instance uuid 6cca7c83-368d-4c02-a00c-d12a84825c27 {{(pid=118525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:12:34.437730 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-69fa3932-f550-42f8-aa7d-5f4b3d436574 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:34.439828 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-69fa3932-f550-42f8-aa7d-5f4b3d436574 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:34.478863 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-69fa3932-f550-42f8-aa7d-5f4b3d436574 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:34.487249 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-69fa3932-f550-42f8-aa7d-5f4b3d436574 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:34.491478 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-69fa3932-f550-42f8-aa7d-5f4b3d436574 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:34.495599 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-69fa3932-f550-42f8-aa7d-5f4b3d436574 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:35.004934 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-5657c727-e02c-4763-ac29-476eb1204031 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "POST /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27/action" status: 202 len: 0 microversion: 2.20 time: 1.055187 Aug 02 09:12:35.020556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 110/216] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Aug 2 09:12:33 2022] POST /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27/action => generated 0 bytes in 1076 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:12:35.031974 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d146b06f-cf74-47d3-9fdd-1974721fc64c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:35.047109 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-d146b06f-cf74-47d3-9fdd-1974721fc64c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:35.090965 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d146b06f-cf74-47d3-9fdd-1974721fc64c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:35.099998 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d146b06f-cf74-47d3-9fdd-1974721fc64c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:35.106485 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d146b06f-cf74-47d3-9fdd-1974721fc64c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:35.110266 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d146b06f-cf74-47d3-9fdd-1974721fc64c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:35.205442 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-69fa3932-f550-42f8-aa7d-5f4b3d436574 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:35.281511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-69fa3932-f550-42f8-aa7d-5f4b3d436574 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1521 microversion: 2.1 time: 0.860158 Aug 02 09:12:35.296141 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 107/217] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:34 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1521 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:35.331017 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-828e29dd-845b-45f0-a04b-18b71c2b1922 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:35.335400 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-828e29dd-845b-45f0-a04b-18b71c2b1922 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:35.363624 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-828e29dd-845b-45f0-a04b-18b71c2b1922 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:35.366135 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-828e29dd-845b-45f0-a04b-18b71c2b1922 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:35.372949 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-828e29dd-845b-45f0-a04b-18b71c2b1922 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:35.372949 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-828e29dd-845b-45f0-a04b-18b71c2b1922 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:35.736592 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d146b06f-cf74-47d3-9fdd-1974721fc64c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:35.779885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-d146b06f-cf74-47d3-9fdd-1974721fc64c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1362 microversion: 2.1 time: 0.752428 Aug 02 09:12:35.797786 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 111/218] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:35 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1362 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:35.945074 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-828e29dd-845b-45f0-a04b-18b71c2b1922 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:35.957480 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-828e29dd-845b-45f0-a04b-18b71c2b1922 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:35.962063 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-828e29dd-845b-45f0-a04b-18b71c2b1922 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:35.963353 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-828e29dd-845b-45f0-a04b-18b71c2b1922 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1723 microversion: 2.20 time: 0.656927 Aug 02 09:12:35.964141 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 108/219] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:35 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1723 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:36.344431 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-f3568244-196c-434b-8a88-2a81e1f9ab8d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:36.356574 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-f3568244-196c-434b-8a88-2a81e1f9ab8d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:36.369455 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f3568244-196c-434b-8a88-2a81e1f9ab8d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:36.370585 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f3568244-196c-434b-8a88-2a81e1f9ab8d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:36.371879 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f3568244-196c-434b-8a88-2a81e1f9ab8d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:36.372600 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f3568244-196c-434b-8a88-2a81e1f9ab8d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:36.835743 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-9fc1b8b9-f4c6-4d98-a4c1-98d9159da6a1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:36.838266 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-9fc1b8b9-f4c6-4d98-a4c1-98d9159da6a1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:36.853115 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9fc1b8b9-f4c6-4d98-a4c1-98d9159da6a1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:36.854258 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9fc1b8b9-f4c6-4d98-a4c1-98d9159da6a1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:36.859514 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9fc1b8b9-f4c6-4d98-a4c1-98d9159da6a1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:36.861054 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9fc1b8b9-f4c6-4d98-a4c1-98d9159da6a1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:36.910316 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-f3568244-196c-434b-8a88-2a81e1f9ab8d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:36.926964 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-f3568244-196c-434b-8a88-2a81e1f9ab8d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1521 microversion: 2.1 time: 0.589613 Aug 02 09:12:36.940640 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 112/220] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:36 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1521 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:37.007794 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-71da21c2-5556-4350-a70d-cdfa15c9e1d5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:37.008496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-71da21c2-5556-4350-a70d-cdfa15c9e1d5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:37.022416 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-71da21c2-5556-4350-a70d-cdfa15c9e1d5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:37.026833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-71da21c2-5556-4350-a70d-cdfa15c9e1d5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:37.027936 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-71da21c2-5556-4350-a70d-cdfa15c9e1d5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:37.029342 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-71da21c2-5556-4350-a70d-cdfa15c9e1d5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:37.224142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-9fc1b8b9-f4c6-4d98-a4c1-98d9159da6a1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:37.226266 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:37.233765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-9fc1b8b9-f4c6-4d98-a4c1-98d9159da6a1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1362 microversion: 2.1 time: 0.410026 Aug 02 09:12:37.240434 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 109/221] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:36 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1362 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:37.383368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-71da21c2-5556-4350-a70d-cdfa15c9e1d5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:37.409774 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-71da21c2-5556-4350-a70d-cdfa15c9e1d5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:37.422715 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-71da21c2-5556-4350-a70d-cdfa15c9e1d5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:37.427326 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-71da21c2-5556-4350-a70d-cdfa15c9e1d5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1723 microversion: 2.20 time: 0.422012 Aug 02 09:12:37.428132 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 113/222] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:37 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1723 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:12:37.966639 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-7f7b59ae-cad9-4b99-802f-4071d5b20018 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:37.975904 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-7f7b59ae-cad9-4b99-802f-4071d5b20018 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:37.975904 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7f7b59ae-cad9-4b99-802f-4071d5b20018 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:37.976238 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7f7b59ae-cad9-4b99-802f-4071d5b20018 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:37.977259 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7f7b59ae-cad9-4b99-802f-4071d5b20018 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:37.977992 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7f7b59ae-cad9-4b99-802f-4071d5b20018 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:38.209177 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-7f7b59ae-cad9-4b99-802f-4071d5b20018 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:38.221071 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-7f7b59ae-cad9-4b99-802f-4071d5b20018 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1521 microversion: 2.1 time: 0.258022 Aug 02 09:12:38.235461 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 110/223] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:37 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:38.289581 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-b5786497-609d-4c95-9b76-474c1774b2b2 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:38.290903 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-b5786497-609d-4c95-9b76-474c1774b2b2 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:38.299466 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b5786497-609d-4c95-9b76-474c1774b2b2 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:38.301309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b5786497-609d-4c95-9b76-474c1774b2b2 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:38.302595 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b5786497-609d-4c95-9b76-474c1774b2b2 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:38.303281 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b5786497-609d-4c95-9b76-474c1774b2b2 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:38.342630 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:38.473746 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-e080ffe5-d70a-4288-8791-1e3245b4957d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:38.474647 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-e080ffe5-d70a-4288-8791-1e3245b4957d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:38.482306 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e080ffe5-d70a-4288-8791-1e3245b4957d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:38.482855 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e080ffe5-d70a-4288-8791-1e3245b4957d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:38.488144 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e080ffe5-d70a-4288-8791-1e3245b4957d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:38.488144 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e080ffe5-d70a-4288-8791-1e3245b4957d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:38.510251 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-b5786497-609d-4c95-9b76-474c1774b2b2 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:38.519660 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-b5786497-609d-4c95-9b76-474c1774b2b2 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1362 microversion: 2.1 time: 0.249466 Aug 02 09:12:38.521108 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 114/224] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:38 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:38.782536 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-e080ffe5-d70a-4288-8791-1e3245b4957d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:38.807010 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-e080ffe5-d70a-4288-8791-1e3245b4957d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:38.808549 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-e080ffe5-d70a-4288-8791-1e3245b4957d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:38.809745 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-e080ffe5-d70a-4288-8791-1e3245b4957d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1723 microversion: 2.20 time: 0.342736 Aug 02 09:12:38.823024 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 111/225] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:38 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1723 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:39.249781 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-377bff6a-c93a-4084-8d07-f3ee828df244 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:39.251079 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-377bff6a-c93a-4084-8d07-f3ee828df244 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:39.290846 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-377bff6a-c93a-4084-8d07-f3ee828df244 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:39.291979 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-377bff6a-c93a-4084-8d07-f3ee828df244 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:39.295122 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-377bff6a-c93a-4084-8d07-f3ee828df244 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:39.297381 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-377bff6a-c93a-4084-8d07-f3ee828df244 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:39.551323 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-956997ed-219e-4aa3-aded-67a79077c341 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:39.554325 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-956997ed-219e-4aa3-aded-67a79077c341 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:39.576352 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-956997ed-219e-4aa3-aded-67a79077c341 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:39.576352 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-956997ed-219e-4aa3-aded-67a79077c341 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:39.576352 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-956997ed-219e-4aa3-aded-67a79077c341 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:39.576352 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-956997ed-219e-4aa3-aded-67a79077c341 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:39.679423 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-377bff6a-c93a-4084-8d07-f3ee828df244 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:39.691204 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-377bff6a-c93a-4084-8d07-f3ee828df244 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1521 microversion: 2.1 time: 0.450087 Aug 02 09:12:39.692141 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 115/226] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:39 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1521 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:39.837551 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-9acb146b-acc9-4773-9c1c-075896eda6f8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:39.838974 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-9acb146b-acc9-4773-9c1c-075896eda6f8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:39.865235 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9acb146b-acc9-4773-9c1c-075896eda6f8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:39.865783 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9acb146b-acc9-4773-9c1c-075896eda6f8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:39.870693 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9acb146b-acc9-4773-9c1c-075896eda6f8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:39.871200 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9acb146b-acc9-4773-9c1c-075896eda6f8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:39.923274 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-956997ed-219e-4aa3-aded-67a79077c341 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:39.934572 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-956997ed-219e-4aa3-aded-67a79077c341 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1362 microversion: 2.1 time: 0.395445 Aug 02 09:12:39.948294 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 112/227] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:39 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1362 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:39.977734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-775c2001-53fa-42a0-bc2d-30cdb98532b7 req-5cf4c2d7-e2be-4a51-86d6-f314a0047572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73c852c4-c5c3-4a1f-94b9-f6515a830bbb", "name": "network-vif-plugged", "status": "completed", "tag": "d833b29e-12d4-4f6f-b2fe-e1239d280814"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:40.006386 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-775c2001-53fa-42a0-bc2d-30cdb98532b7 req-5cf4c2d7-e2be-4a51-86d6-f314a0047572 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:40.006386 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-775c2001-53fa-42a0-bc2d-30cdb98532b7 req-5cf4c2d7-e2be-4a51-86d6-f314a0047572 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:40.061026 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-775c2001-53fa-42a0-bc2d-30cdb98532b7 req-5cf4c2d7-e2be-4a51-86d6-f314a0047572 service nova] Creating event network-vif-plugged:d833b29e-12d4-4f6f-b2fe-e1239d280814 for instance 73c852c4-c5c3-4a1f-94b9-f6515a830bbb on hv-cinder-84599 Aug 02 09:12:40.090384 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-775c2001-53fa-42a0-bc2d-30cdb98532b7 req-5cf4c2d7-e2be-4a51-86d6-f314a0047572 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139618 Aug 02 09:12:40.091122 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 113/228] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:12:40.274517 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-9acb146b-acc9-4773-9c1c-075896eda6f8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:40.305212 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-9acb146b-acc9-4773-9c1c-075896eda6f8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:40.316065 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-9acb146b-acc9-4773-9c1c-075896eda6f8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:40.317415 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-9acb146b-acc9-4773-9c1c-075896eda6f8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1723 microversion: 2.20 time: 0.484898 Aug 02 09:12:40.317998 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 116/229] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:39 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1723 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:40.724387 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-f1aed926-bbc2-42a1-bbff-429b1bc5e144 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:40.731688 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-f1aed926-bbc2-42a1-bbff-429b1bc5e144 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:40.789344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f1aed926-bbc2-42a1-bbff-429b1bc5e144 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:40.790310 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f1aed926-bbc2-42a1-bbff-429b1bc5e144 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:40.791766 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f1aed926-bbc2-42a1-bbff-429b1bc5e144 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:40.792796 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f1aed926-bbc2-42a1-bbff-429b1bc5e144 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:40.971442 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-7074bff7-0759-4325-97a4-bc4d9de2293a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:40.989120 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-7074bff7-0759-4325-97a4-bc4d9de2293a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:41.012881 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:41.020015 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7074bff7-0759-4325-97a4-bc4d9de2293a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:41.020949 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7074bff7-0759-4325-97a4-bc4d9de2293a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:41.022626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7074bff7-0759-4325-97a4-bc4d9de2293a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:41.025595 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7074bff7-0759-4325-97a4-bc4d9de2293a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:41.229839 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-f1aed926-bbc2-42a1-bbff-429b1bc5e144 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:41.259070 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-f1aed926-bbc2-42a1-bbff-429b1bc5e144 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1521 microversion: 2.1 time: 0.544590 Aug 02 09:12:41.260382 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 114/230] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:40 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1521 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:41.368535 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-285a069f-9517-42d9-954d-a614951ae3ed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:41.378621 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-285a069f-9517-42d9-954d-a614951ae3ed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:41.421314 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-285a069f-9517-42d9-954d-a614951ae3ed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:41.422110 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-285a069f-9517-42d9-954d-a614951ae3ed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:41.432234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-285a069f-9517-42d9-954d-a614951ae3ed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:41.432699 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-285a069f-9517-42d9-954d-a614951ae3ed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:41.785586 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-7074bff7-0759-4325-97a4-bc4d9de2293a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:41.821411 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-7074bff7-0759-4325-97a4-bc4d9de2293a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1362 microversion: 2.1 time: 0.862026 Aug 02 09:12:41.822160 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 117/231] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:40 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1362 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:41.966315 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-285a069f-9517-42d9-954d-a614951ae3ed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:41.973859 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-285a069f-9517-42d9-954d-a614951ae3ed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:41.986424 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-285a069f-9517-42d9-954d-a614951ae3ed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:41.993516 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-285a069f-9517-42d9-954d-a614951ae3ed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1723 microversion: 2.20 time: 0.633150 Aug 02 09:12:42.008556 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 115/232] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:41 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1723 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:42.304677 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-0bc5a567-0f2e-4c35-8582-11c2a68ed2ac tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:42.312722 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-0bc5a567-0f2e-4c35-8582-11c2a68ed2ac tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:42.321185 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0bc5a567-0f2e-4c35-8582-11c2a68ed2ac tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:42.322098 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0bc5a567-0f2e-4c35-8582-11c2a68ed2ac tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:42.323805 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0bc5a567-0f2e-4c35-8582-11c2a68ed2ac tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:42.324919 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0bc5a567-0f2e-4c35-8582-11c2a68ed2ac tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:42.543579 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-0bc5a567-0f2e-4c35-8582-11c2a68ed2ac tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:42.553964 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-0bc5a567-0f2e-4c35-8582-11c2a68ed2ac tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1521 microversion: 2.1 time: 0.257029 Aug 02 09:12:42.554943 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 118/233] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:42 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:42.883681 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c400158f-11c9-4223-9662-2e47fb0faee8 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:42.885992 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-c400158f-11c9-4223-9662-2e47fb0faee8 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:42.910734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c400158f-11c9-4223-9662-2e47fb0faee8 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:42.912287 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c400158f-11c9-4223-9662-2e47fb0faee8 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:42.914383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c400158f-11c9-4223-9662-2e47fb0faee8 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:42.915637 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c400158f-11c9-4223-9662-2e47fb0faee8 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:43.048515 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-a8059225-bb70-429e-885c-abcd1816c6e1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:43.051847 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-a8059225-bb70-429e-885c-abcd1816c6e1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:43.094198 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a8059225-bb70-429e-885c-abcd1816c6e1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:43.095875 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a8059225-bb70-429e-885c-abcd1816c6e1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:43.102282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a8059225-bb70-429e-885c-abcd1816c6e1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:43.104902 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a8059225-bb70-429e-885c-abcd1816c6e1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:43.445574 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-c400158f-11c9-4223-9662-2e47fb0faee8 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:43.462392 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-c400158f-11c9-4223-9662-2e47fb0faee8 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1362 microversion: 2.1 time: 0.598400 Aug 02 09:12:43.482663 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 116/234] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:42 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1362 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:43.543539 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-a8059225-bb70-429e-885c-abcd1816c6e1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:43.555709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-a8059225-bb70-429e-885c-abcd1816c6e1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:43.558131 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-a8059225-bb70-429e-885c-abcd1816c6e1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:43.562932 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-a8059225-bb70-429e-885c-abcd1816c6e1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1723 microversion: 2.20 time: 0.524491 Aug 02 09:12:43.563700 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 119/235] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:43 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1723 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:43.582865 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-9ecc778d-3307-48ce-b615-3eda94a8a637 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:43.584041 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-9ecc778d-3307-48ce-b615-3eda94a8a637 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:43.614565 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9ecc778d-3307-48ce-b615-3eda94a8a637 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:43.619769 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9ecc778d-3307-48ce-b615-3eda94a8a637 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:43.621536 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9ecc778d-3307-48ce-b615-3eda94a8a637 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:43.623003 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9ecc778d-3307-48ce-b615-3eda94a8a637 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:43.854770 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-9ecc778d-3307-48ce-b615-3eda94a8a637 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:43.873631 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-9ecc778d-3307-48ce-b615-3eda94a8a637 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1501 microversion: 2.1 time: 0.298299 Aug 02 09:12:43.875600 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 117/236] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:43 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1501 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:43.916542 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-da0eccca-81b9-403d-99f0-9e89e90677b1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a85d306c-c477-4dc8-a233-c309d02b92a3"}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:43.920329 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-da0eccca-81b9-403d-99f0-9e89e90677b1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:43.929938 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-da0eccca-81b9-403d-99f0-9e89e90677b1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:43.930452 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-da0eccca-81b9-403d-99f0-9e89e90677b1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:43.931524 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-da0eccca-81b9-403d-99f0-9e89e90677b1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:43.932011 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-da0eccca-81b9-403d-99f0-9e89e90677b1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:43.963035 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-da0eccca-81b9-403d-99f0-9e89e90677b1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] HTTP exception thrown: Cannot 'attach_volume' instance 44854eb9-caa3-4fc7-bd14-6a150fcafcd3 while it is in vm_state rescued Aug 02 09:12:43.964885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-da0eccca-81b9-403d-99f0-9e89e90677b1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Request method failure captured: Aug 02 09:12:43.964885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: POST /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3/os-volume_attachments HTTP/1.1 Aug 02 09:12:43.964885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:12:43.964885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:12:43.964885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:12:43.964885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 74 Aug 02 09:12:43.964885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:12:43.964885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:12:43.964885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:12:43.964885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:12:43.964885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6OoRmwjoNYhYnEcpgvvMEgd2xKWzF42xFe2mQGMLj3xIf2rbW7jLb_M6K5s8XRrNt0jgV2BkoLp__0sW_xWvmzuZaSam16BGZbPOtbFV1QdDLxB4qZlviKTAjvfQC9uvL31nkGmI2TvBy6_wRRQkKYA6ErGyVZGDEB2BoL_ZMmAWEOk Aug 02 09:12:43.964885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:12:43.964885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:12:43.964885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:12:43.964885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:12:43.964885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:12:43.964885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:12:43.964885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: 5b01727cea94442bb62b56e7a4ae57a0 Aug 02 09:12:43.964885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1040473499 Aug 02 09:12:43.964885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:12:43.964885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:12:43.966697 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b01727cea94442bb62b56e7a4ae57a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b01727cea94442bb62b56e7a4ae57a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b01727cea94442bb62b56e7a4ae57a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b01727cea94442bb62b56e7a4ae57a0"}]}] Aug 02 09:12:43.966697 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1040473499 Aug 02 09:12:43.966697 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: 5b01727cea94442bb62b56e7a4ae57a0 Aug 02 09:12:43.966697 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1040473499 Aug 02 09:12:43.966697 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-ServerRescueNegativeTestJSON-1040473499-project Aug 02 09:12:43.966697 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:12:43.966697 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:12:43.966697 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: 1eda94767d1547fa82f6407a4c7de1d8 Aug 02 09:12:43.966697 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1040473499-project Aug 02 09:12:43.966697 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Aug 02 09:12:43.966697 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {"volumeAttachment": {"volumeId": "a85d306c-c477-4dc8-a233-c309d02b92a3"}} Aug 02 09:12:43.966697 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: > Aug 02 09:12:43.967616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Cannot 'attach_volume' instance 44854eb9-caa3-4fc7-bd14-6a150fcafcd3 while it is in vm_state rescued Aug 02 09:12:43.967616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'server_id': '44854eb9-caa3-4fc7-bd14-6a150fcafcd3', 'body': {'volumeAttachment': {'volumeId': 'a85d306c-c477-4dc8-a233-c309d02b92a3'}}} Aug 02 09:12:43.967616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:12:43.967616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:12:43.967616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 09:12:43.967616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 09:12:43.967616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 09:12:43.967616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:12:43.967616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 09:12:43.967616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 09:12:43.967616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 44854eb9-caa3-4fc7-bd14-6a150fcafcd3 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 02 09:12:43.967616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:12:43.967616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:12:43.967616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:12:43.967616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:12:43.967616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:12:43.967616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:12:43.967616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:12:43.967616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:12:43.969626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:12:43.969626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:12:43.969626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:12:43.969626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:12:43.969626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:12:43.969626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:12:43.969626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:12:43.969626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:12:43.969626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 02 09:12:43.969626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 09:12:43.969626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 09:12:43.969626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 09:12:43.969626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 44854eb9-caa3-4fc7-bd14-6a150fcafcd3 while it is in vm_state rescued Aug 02 09:12:43.969626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:12:43.969626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:12:43.969626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:12:43.969626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:12:43.969626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:12:43.969626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:12:43.972180 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:12:43.972180 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:12:43.972180 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 44854eb9-caa3-4fc7-bd14-6a150fcafcd3 while it is in vm_state rescued Aug 02 09:12:43.972180 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:12:43.972180 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-da0eccca-81b9-403d-99f0-9e89e90677b1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Returning 409 to user: Cannot 'attach_volume' instance 44854eb9-caa3-4fc7-bd14-6a150fcafcd3 while it is in vm_state rescued {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:12:43.972180 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-da0eccca-81b9-403d-99f0-9e89e90677b1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "POST /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.055192 Aug 02 09:12:43.972180 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 120/237] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 2 09:12:43 2022] POST /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3/os-volume_attachments => generated 152 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 09:12:43.978380 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-6297fca0-5fc0-4432-9536-67b1eb12bb11 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:43.978925 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-6297fca0-5fc0-4432-9536-67b1eb12bb11 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:43.996614 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6297fca0-5fc0-4432-9536-67b1eb12bb11 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:43.998301 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6297fca0-5fc0-4432-9536-67b1eb12bb11 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:43.999612 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6297fca0-5fc0-4432-9536-67b1eb12bb11 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:44.000459 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6297fca0-5fc0-4432-9536-67b1eb12bb11 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:44.330031 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-6297fca0-5fc0-4432-9536-67b1eb12bb11 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "POST /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3/action" status: 202 len: 0 microversion: 2.1 time: 0.355245 Aug 02 09:12:44.337803 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 118/238] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 2 09:12:43 2022] POST /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3/action => generated 0 bytes in 365 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:12:44.343111 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-f806c31b-3a2d-4679-bcc0-869ea674630c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:44.343744 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-f806c31b-3a2d-4679-bcc0-869ea674630c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:44.377439 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f806c31b-3a2d-4679-bcc0-869ea674630c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:44.378944 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f806c31b-3a2d-4679-bcc0-869ea674630c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:44.380051 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f806c31b-3a2d-4679-bcc0-869ea674630c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:44.380586 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f806c31b-3a2d-4679-bcc0-869ea674630c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:44.498214 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-7ff7fcde-b218-4677-b6ba-0bacfdb69404 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:44.500415 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-7ff7fcde-b218-4677-b6ba-0bacfdb69404 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:44.520927 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7ff7fcde-b218-4677-b6ba-0bacfdb69404 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:44.521991 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7ff7fcde-b218-4677-b6ba-0bacfdb69404 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:44.527237 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7ff7fcde-b218-4677-b6ba-0bacfdb69404 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:44.527784 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7ff7fcde-b218-4677-b6ba-0bacfdb69404 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:44.930030 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-f806c31b-3a2d-4679-bcc0-869ea674630c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:44.945743 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-f806c31b-3a2d-4679-bcc0-869ea674630c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1509 microversion: 2.1 time: 0.606355 Aug 02 09:12:44.946692 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 121/239] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:44 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1509 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:44.957024 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-bab2e4c4-9480-4230-821e-a85460dec497 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:44.957024 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-bab2e4c4-9480-4230-821e-a85460dec497 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:44.997773 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bab2e4c4-9480-4230-821e-a85460dec497 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:44.998225 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bab2e4c4-9480-4230-821e-a85460dec497 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:44.999219 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bab2e4c4-9480-4230-821e-a85460dec497 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:44.999704 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bab2e4c4-9480-4230-821e-a85460dec497 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:45.048454 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-7ff7fcde-b218-4677-b6ba-0bacfdb69404 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:45.064061 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-7ff7fcde-b218-4677-b6ba-0bacfdb69404 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1545 microversion: 2.1 time: 0.573598 Aug 02 09:12:45.065398 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 119/240] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:44 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1545 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:45.076461 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-73d9e3cc-ac8b-44f3-9e15-b63dd5013d4a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Action: 'create', calling method: .version_select at 0x7ffb9ad54b80>, body: {"keypair": {"name": "tempest-keypair-1312668077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLBppTHwJirHrpbpNbxPlxRH+4eTfQlRzR9zrtWMI7icBglT1zt4lEH8bvpdrBon6nPVpjWAR2vq5jxneYbcJ+qC1Jxj8zKezQ8v3bG4AGhHPiiJn6r7iMrNYnTAwO349A=="}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:45.100628 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-73d9e3cc-ac8b-44f3-9e15-b63dd5013d4a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Getting quotas for project b6fc6b07497a48eeb263b3a9b8aa7499. Resources: {'key_pairs'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:12:45.106617 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-73d9e3cc-ac8b-44f3-9e15-b63dd5013d4a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Getting quotas for user ad3a9141e9284bb5a096fb04d3e9d581 and project b6fc6b07497a48eeb263b3a9b8aa7499. Resources: {'key_pairs'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:12:45.259348 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-73d9e3cc-ac8b-44f3-9e15-b63dd5013d4a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.188983 Aug 02 09:12:45.262642 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 120/241] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 2 09:12:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:12:45.439287 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-08a07175-6868-4274-b767-4c04a61b7ee3 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:45.439287 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-08a07175-6868-4274-b767-4c04a61b7ee3 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:45.439287 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-08a07175-6868-4274-b767-4c04a61b7ee3 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:45.439287 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-08a07175-6868-4274-b767-4c04a61b7ee3 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:45.441493 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-08a07175-6868-4274-b767-4c04a61b7ee3 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:45.441493 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-08a07175-6868-4274-b767-4c04a61b7ee3 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:45.457060 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-bab2e4c4-9480-4230-821e-a85460dec497 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:45.480951 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-bab2e4c4-9480-4230-821e-a85460dec497 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:45.483740 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-bab2e4c4-9480-4230-821e-a85460dec497 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:45.485816 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-bab2e4c4-9480-4230-821e-a85460dec497 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1723 microversion: 2.20 time: 0.537910 Aug 02 09:12:45.487695 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 122/242] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:44 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1723 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:45.668634 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-08a07175-6868-4274-b767-4c04a61b7ee3 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.371621 Aug 02 09:12:45.669984 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 121/243] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Aug 2 09:12:45 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb/os-interface => generated 284 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:12:45.996113 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-96323b45-56ff-4515-ad15-5c7ede7ca01d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:45.998917 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-96323b45-56ff-4515-ad15-5c7ede7ca01d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:46.010923 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-96323b45-56ff-4515-ad15-5c7ede7ca01d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:46.011234 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-96323b45-56ff-4515-ad15-5c7ede7ca01d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:46.012200 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-96323b45-56ff-4515-ad15-5c7ede7ca01d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:46.012635 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-96323b45-56ff-4515-ad15-5c7ede7ca01d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:46.403396 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-96323b45-56ff-4515-ad15-5c7ede7ca01d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:46.413662 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-96323b45-56ff-4515-ad15-5c7ede7ca01d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1509 microversion: 2.1 time: 0.423320 Aug 02 09:12:46.414529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 123/244] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:45 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1509 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:46.541943 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-feb70a3d-aaf2-4935-9752-2d3b366041bd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:46.542673 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-feb70a3d-aaf2-4935-9752-2d3b366041bd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:46.551790 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-feb70a3d-aaf2-4935-9752-2d3b366041bd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:46.560049 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-feb70a3d-aaf2-4935-9752-2d3b366041bd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:46.560049 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-feb70a3d-aaf2-4935-9752-2d3b366041bd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:46.560049 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-feb70a3d-aaf2-4935-9752-2d3b366041bd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:47.109560 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-feb70a3d-aaf2-4935-9752-2d3b366041bd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:47.125961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-feb70a3d-aaf2-4935-9752-2d3b366041bd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:47.127585 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-feb70a3d-aaf2-4935-9752-2d3b366041bd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:47.129764 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-feb70a3d-aaf2-4935-9752-2d3b366041bd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1723 microversion: 2.20 time: 0.592447 Aug 02 09:12:47.146708 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 122/245] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:46 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1723 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:47.442952 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-80bd9398-ceb3-4dde-8053-b0b3a555cac6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:47.444857 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-80bd9398-ceb3-4dde-8053-b0b3a555cac6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:47.459421 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-80bd9398-ceb3-4dde-8053-b0b3a555cac6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:47.460218 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-80bd9398-ceb3-4dde-8053-b0b3a555cac6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:47.461388 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-80bd9398-ceb3-4dde-8053-b0b3a555cac6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:47.462561 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-80bd9398-ceb3-4dde-8053-b0b3a555cac6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:47.592898 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-a99f1f17-d678-426e-ac93-0a71cd553744 req-0a5174b4-1546-4402-9251-76ad27d60bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "73c852c4-c5c3-4a1f-94b9-f6515a830bbb", "tag": "d833b29e-12d4-4f6f-b2fe-e1239d280814"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:47.606666 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-a99f1f17-d678-426e-ac93-0a71cd553744 req-0a5174b4-1546-4402-9251-76ad27d60bb5 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:47.607159 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-a99f1f17-d678-426e-ac93-0a71cd553744 req-0a5174b4-1546-4402-9251-76ad27d60bb5 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:48.014508 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-a99f1f17-d678-426e-ac93-0a71cd553744 req-0a5174b4-1546-4402-9251-76ad27d60bb5 service nova] Creating event network-changed:d833b29e-12d4-4f6f-b2fe-e1239d280814 for instance 73c852c4-c5c3-4a1f-94b9-f6515a830bbb on hv-cinder-84599 Aug 02 09:12:48.030738 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-a99f1f17-d678-426e-ac93-0a71cd553744 req-0a5174b4-1546-4402-9251-76ad27d60bb5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.438553 Aug 02 09:12:48.033561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 123/246] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:12:48.164772 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-fd601d01-c8b4-446e-8c71-72d5ffb7bdf8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:48.167472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-fd601d01-c8b4-446e-8c71-72d5ffb7bdf8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:48.182049 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-80bd9398-ceb3-4dde-8053-b0b3a555cac6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:48.196858 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-80bd9398-ceb3-4dde-8053-b0b3a555cac6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1509 microversion: 2.1 time: 0.761394 Aug 02 09:12:48.207078 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fd601d01-c8b4-446e-8c71-72d5ffb7bdf8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:48.224325 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 124/247] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:47 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1509 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:48.224910 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fd601d01-c8b4-446e-8c71-72d5ffb7bdf8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:48.224910 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fd601d01-c8b4-446e-8c71-72d5ffb7bdf8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:48.224910 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fd601d01-c8b4-446e-8c71-72d5ffb7bdf8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:48.857691 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-fd601d01-c8b4-446e-8c71-72d5ffb7bdf8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:48.889217 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-fd601d01-c8b4-446e-8c71-72d5ffb7bdf8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:48.906896 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-fd601d01-c8b4-446e-8c71-72d5ffb7bdf8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:48.911549 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-fd601d01-c8b4-446e-8c71-72d5ffb7bdf8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1723 microversion: 2.20 time: 0.751513 Aug 02 09:12:48.918822 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 124/248] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:48 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1723 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:12:49.253695 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-86c1c9db-4d49-4822-b3bc-5714e13f6e2d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:49.254550 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-86c1c9db-4d49-4822-b3bc-5714e13f6e2d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:49.272133 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-86c1c9db-4d49-4822-b3bc-5714e13f6e2d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:49.273632 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-86c1c9db-4d49-4822-b3bc-5714e13f6e2d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:49.275655 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-86c1c9db-4d49-4822-b3bc-5714e13f6e2d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:49.277708 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-86c1c9db-4d49-4822-b3bc-5714e13f6e2d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:49.976263 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-51d6e544-b532-41df-a6f0-6ea33d46518a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:49.976263 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-51d6e544-b532-41df-a6f0-6ea33d46518a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:49.988868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-51d6e544-b532-41df-a6f0-6ea33d46518a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:49.989595 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-51d6e544-b532-41df-a6f0-6ea33d46518a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:49.990475 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-51d6e544-b532-41df-a6f0-6ea33d46518a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:49.990915 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-51d6e544-b532-41df-a6f0-6ea33d46518a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:50.127809 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-86c1c9db-4d49-4822-b3bc-5714e13f6e2d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:50.161075 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-86c1c9db-4d49-4822-b3bc-5714e13f6e2d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1515 microversion: 2.1 time: 0.914760 Aug 02 09:12:50.164397 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 125/249] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:49 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1515 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:50.483054 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-51d6e544-b532-41df-a6f0-6ea33d46518a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:50.525407 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-51d6e544-b532-41df-a6f0-6ea33d46518a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:50.539488 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-51d6e544-b532-41df-a6f0-6ea33d46518a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:50.547476 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-51d6e544-b532-41df-a6f0-6ea33d46518a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1723 microversion: 2.20 time: 0.588327 Aug 02 09:12:50.550767 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 125/250] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:49 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1723 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:50.977804 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-0189b718-f00a-47bb-a7df-64c0d86abbb0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Action: 'create', calling method: .version_select at 0x7ffb9ac7e1f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-425466987", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdR0MzsCb57s7bZ5sRYLudppTwS4VHSGot62X91BdyUZ1CIbmWP5G2teeLEcoMRT8thKHJSj94zUCQ2rrCHIMuulQXhmaOWTaC5kS18y1/ay1FwrPJsWUnl0cMAmZsFxQ=="}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:51.026324 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-0189b718-f00a-47bb-a7df-64c0d86abbb0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Getting quotas for project ebb47864b5694d2e85b1d90eb2c809bc. Resources: {'key_pairs'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:12:51.035741 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-0189b718-f00a-47bb-a7df-64c0d86abbb0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Getting quotas for user 75559881115047eeb72554769404ed0a and project ebb47864b5694d2e85b1d90eb2c809bc. Resources: {'key_pairs'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:12:51.170984 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-0189b718-f00a-47bb-a7df-64c0d86abbb0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.448711 Aug 02 09:12:51.178971 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 126/251] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 2 09:12:50 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:12:51.576378 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-66b27564-8328-4dbf-a04a-b50cdb29de67 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:51.577077 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-66b27564-8328-4dbf-a04a-b50cdb29de67 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:51.592827 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-66b27564-8328-4dbf-a04a-b50cdb29de67 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:51.593281 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-66b27564-8328-4dbf-a04a-b50cdb29de67 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:51.598015 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-66b27564-8328-4dbf-a04a-b50cdb29de67 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:51.599034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-66b27564-8328-4dbf-a04a-b50cdb29de67 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:51.867575 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-66b27564-8328-4dbf-a04a-b50cdb29de67 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:51.885553 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-66b27564-8328-4dbf-a04a-b50cdb29de67 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:51.891452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-66b27564-8328-4dbf-a04a-b50cdb29de67 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:51.893089 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-66b27564-8328-4dbf-a04a-b50cdb29de67 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1744 microversion: 2.20 time: 0.321871 Aug 02 09:12:51.895918 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 126/252] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:51 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1744 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:52.417968 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ba5997d4-f98d-4d7a-83f3-2285584f1760 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-839013230", "imageRef": "7a52f4c5-c531-494a-b375-4f6dce3abbc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51ed4955-009d-4088-8f3a-112c98fc8362"}], "security_groups": [{"name": "tempest-securitygroup--1925431160"}], "key_name": "tempest-keypair-1312668077", "user_data": "}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:52.529944 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-0eb569f5-8e48-441d-a6af-f424050a66e7 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Action: 'create', calling method: .version_select at 0x7ffb9ac74280>, body: {"keypair": {"name": "tempest-keypair-1521917604", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH8Iar3n3WN9DHD7ztknl+EqXRvmrayTaQEZO4hX9uJwPq2AyYZlXepEq8CHeAhZSUyzwDCJcru4ztmA6U3XBjNkcz+9KN88spXY0dP/lVxQpCZSY/sFr8jwYZEoytvIRQ=="}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:52.565159 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-0eb569f5-8e48-441d-a6af-f424050a66e7 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Getting quotas for project 5b01727cea94442bb62b56e7a4ae57a0. Resources: {'key_pairs'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:12:52.578337 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-0eb569f5-8e48-441d-a6af-f424050a66e7 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Getting quotas for user 1eda94767d1547fa82f6407a4c7de1d8 and project 5b01727cea94442bb62b56e7a4ae57a0. Resources: {'key_pairs'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:12:52.633045 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.network.neutron [None req-ba5997d4-f98d-4d7a-83f3-2285584f1760 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] validate_networks() for [('51ed4955-009d-4088-8f3a-112c98fc8362', None, None, None, None, None)] {{(pid=118525) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:12:52.720648 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-0eb569f5-8e48-441d-a6af-f424050a66e7 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.197734 Aug 02 09:12:52.722794 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 127/253] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 2 09:12:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:12:52.935730 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-5e612a32-b2f3-4553-b89c-daab0f8b40b6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:52.937470 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-5e612a32-b2f3-4553-b89c-daab0f8b40b6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:52.960769 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5e612a32-b2f3-4553-b89c-daab0f8b40b6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:52.965403 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5e612a32-b2f3-4553-b89c-daab0f8b40b6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:52.965403 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5e612a32-b2f3-4553-b89c-daab0f8b40b6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:52.965403 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5e612a32-b2f3-4553-b89c-daab0f8b40b6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:53.537163 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-5e612a32-b2f3-4553-b89c-daab0f8b40b6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:53.590880 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-5e612a32-b2f3-4553-b89c-daab0f8b40b6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:53.604719 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-5e612a32-b2f3-4553-b89c-daab0f8b40b6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:53.611993 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-5e612a32-b2f3-4553-b89c-daab0f8b40b6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1744 microversion: 2.20 time: 0.679038 Aug 02 09:12:53.611993 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 128/254] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:52 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1744 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:53.655897 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-ba5997d4-f98d-4d7a-83f3-2285584f1760 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Flavor limits 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:12:53.657331 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-ba5997d4-f98d-4d7a-83f3-2285584f1760 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Image limits 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:12:53.659052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-ba5997d4-f98d-4d7a-83f3-2285584f1760 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Flavor pref 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:12:53.659812 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-ba5997d4-f98d-4d7a-83f3-2285584f1760 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Image pref 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:12:53.660466 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-ba5997d4-f98d-4d7a-83f3-2285584f1760 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:12:53.677533 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ba5997d4-f98d-4d7a-83f3-2285584f1760 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:53.678403 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ba5997d4-f98d-4d7a-83f3-2285584f1760 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:53.679578 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ba5997d4-f98d-4d7a-83f3-2285584f1760 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:53.680544 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ba5997d4-f98d-4d7a-83f3-2285584f1760 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:53.711684 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-ba5997d4-f98d-4d7a-83f3-2285584f1760 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Getting quotas for project b6fc6b07497a48eeb263b3a9b8aa7499. Resources: {'cores', 'ram', 'instances'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:12:53.717109 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-ba5997d4-f98d-4d7a-83f3-2285584f1760 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Getting quotas for user ad3a9141e9284bb5a096fb04d3e9d581 and project b6fc6b07497a48eeb263b3a9b8aa7499. Resources: {'cores', 'ram', 'instances'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:12:53.726854 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-ad4b6204-ad90-4c73-a571-d6cfb281ed5f req-a78ccb86-4b00-4caa-ad6d-66c7880496b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cca7c83-368d-4c02-a00c-d12a84825c27", "name": "network-vif-plugged", "status": "completed", "tag": "8f442acd-437f-4082-97ec-7f28749a0a8b"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:53.734447 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ba5997d4-f98d-4d7a-83f3-2285584f1760 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Going to run 1 instances... {{(pid=118525) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:12:53.740890 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ba5997d4-f98d-4d7a-83f3-2285584f1760 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7a52f4c5-c531-494a-b375-4f6dce3abbc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118525) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:12:53.758310 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-ad4b6204-ad90-4c73-a571-d6cfb281ed5f req-a78ccb86-4b00-4caa-ad6d-66c7880496b4 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:53.759256 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-ad4b6204-ad90-4c73-a571-d6cfb281ed5f req-a78ccb86-4b00-4caa-ad6d-66c7880496b4 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:53.763811 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:53.774925 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-ad4b6204-ad90-4c73-a571-d6cfb281ed5f req-a78ccb86-4b00-4caa-ad6d-66c7880496b4 service nova] Creating event network-vif-plugged:8f442acd-437f-4082-97ec-7f28749a0a8b for instance 6cca7c83-368d-4c02-a00c-d12a84825c27 on hv-cinder-84599 Aug 02 09:12:53.786130 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-ad4b6204-ad90-4c73-a571-d6cfb281ed5f req-a78ccb86-4b00-4caa-ad6d-66c7880496b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083771 Aug 02 09:12:53.787047 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 129/255] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:12:53.984685 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ba5997d4-f98d-4d7a-83f3-2285584f1760 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.573476 Aug 02 09:12:53.986095 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 127/256] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 2 09:12:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 1576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 09:12:54.005799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-ddb8d306-61bf-4f0d-81b9-8c2580a86b2b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:54.007600 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-ddb8d306-61bf-4f0d-81b9-8c2580a86b2b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:54.108374 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-ddb8d306-61bf-4f0d-81b9-8c2580a86b2b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:54.123822 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-ddb8d306-61bf-4f0d-81b9-8c2580a86b2b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1241 microversion: 2.1 time: 0.130000 Aug 02 09:12:54.127346 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 130/257] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:53 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1241 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:54.644949 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-288000a9-337c-4d2d-95c6-caba392790ec tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:54.646522 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-288000a9-337c-4d2d-95c6-caba392790ec tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:54.660210 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-288000a9-337c-4d2d-95c6-caba392790ec tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:54.662713 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-288000a9-337c-4d2d-95c6-caba392790ec tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:54.663703 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-288000a9-337c-4d2d-95c6-caba392790ec tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:54.664213 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-288000a9-337c-4d2d-95c6-caba392790ec tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:55.139052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-288000a9-337c-4d2d-95c6-caba392790ec tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:55.153509 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-26d73f04-9499-4de7-a14a-ff5eb7443b75 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:55.154576 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-26d73f04-9499-4de7-a14a-ff5eb7443b75 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:55.157077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-288000a9-337c-4d2d-95c6-caba392790ec tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:55.167459 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-288000a9-337c-4d2d-95c6-caba392790ec tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:55.169016 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-288000a9-337c-4d2d-95c6-caba392790ec tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1739 microversion: 2.20 time: 0.535514 Aug 02 09:12:55.170196 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 128/258] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:54 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1739 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:55.396072 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-26d73f04-9499-4de7-a14a-ff5eb7443b75 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:55.425245 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-26d73f04-9499-4de7-a14a-ff5eb7443b75 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1241 microversion: 2.1 time: 0.278807 Aug 02 09:12:55.442016 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 131/259] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:55 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1241 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:56.214460 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-b6fd0cc5-4d7a-45b8-97be-abe6227d8309 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:56.215372 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-b6fd0cc5-4d7a-45b8-97be-abe6227d8309 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:56.235819 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b6fd0cc5-4d7a-45b8-97be-abe6227d8309 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:56.236307 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b6fd0cc5-4d7a-45b8-97be-abe6227d8309 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:56.237768 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b6fd0cc5-4d7a-45b8-97be-abe6227d8309 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:56.238418 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b6fd0cc5-4d7a-45b8-97be-abe6227d8309 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:56.465444 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-7cd8f233-4603-455d-8467-389cc68ddb68 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:56.466292 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-7cd8f233-4603-455d-8467-389cc68ddb68 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:56.476581 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7cd8f233-4603-455d-8467-389cc68ddb68 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:56.477290 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7cd8f233-4603-455d-8467-389cc68ddb68 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:56.478633 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7cd8f233-4603-455d-8467-389cc68ddb68 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:56.479211 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7cd8f233-4603-455d-8467-389cc68ddb68 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:56.684850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-7cd8f233-4603-455d-8467-389cc68ddb68 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:56.699650 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-7cd8f233-4603-455d-8467-389cc68ddb68 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1237 microversion: 2.1 time: 0.239345 Aug 02 09:12:56.704857 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 132/260] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:56 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1237 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:12:56.806954 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-b6fd0cc5-4d7a-45b8-97be-abe6227d8309 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:56.822030 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-b6fd0cc5-4d7a-45b8-97be-abe6227d8309 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:56.825296 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-b6fd0cc5-4d7a-45b8-97be-abe6227d8309 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:56.828082 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-b6fd0cc5-4d7a-45b8-97be-abe6227d8309 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1739 microversion: 2.20 time: 0.618461 Aug 02 09:12:56.830262 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 129/261] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:56 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1739 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:12:57.734192 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-48e7cf64-8a89-49e9-8459-de3351d188e4 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:57.738695 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-48e7cf64-8a89-49e9-8459-de3351d188e4 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:57.753560 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-48e7cf64-8a89-49e9-8459-de3351d188e4 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:57.754390 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-48e7cf64-8a89-49e9-8459-de3351d188e4 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:57.755886 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-48e7cf64-8a89-49e9-8459-de3351d188e4 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:57.756728 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-48e7cf64-8a89-49e9-8459-de3351d188e4 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:57.868551 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-f850e8cd-2fe7-4473-af62-a34eed92fcef tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:57.873951 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-f850e8cd-2fe7-4473-af62-a34eed92fcef tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:57.897670 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f850e8cd-2fe7-4473-af62-a34eed92fcef tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:57.898202 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f850e8cd-2fe7-4473-af62-a34eed92fcef tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:57.899217 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f850e8cd-2fe7-4473-af62-a34eed92fcef tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:57.899782 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f850e8cd-2fe7-4473-af62-a34eed92fcef tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:58.002023 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-48e7cf64-8a89-49e9-8459-de3351d188e4 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:58.012376 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-48e7cf64-8a89-49e9-8459-de3351d188e4 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1293 microversion: 2.1 time: 0.285043 Aug 02 09:12:58.017261 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 133/262] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:57 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1293 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:58.075031 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-697e89e6-ce23-40f5-ab97-4e2c1bd89d77 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-469796400", "imageRef": "7a52f4c5-c531-494a-b375-4f6dce3abbc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "279b0e6d-910d-4002-a8c0-bb7f28f694b8"}], "security_groups": [{"name": "tempest-securitygroup--1563441050"}], "key_name": "tempest-keypair-1521917604", "user_data": "}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:12:58.243246 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-f850e8cd-2fe7-4473-af62-a34eed92fcef tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:58.267577 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-f850e8cd-2fe7-4473-af62-a34eed92fcef tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:58.269967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-f850e8cd-2fe7-4473-af62-a34eed92fcef tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:58.280405 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-f850e8cd-2fe7-4473-af62-a34eed92fcef tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1739 microversion: 2.20 time: 0.423352 Aug 02 09:12:58.282383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 130/263] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:57 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1739 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:12:58.347864 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.network.neutron [None req-697e89e6-ce23-40f5-ab97-4e2c1bd89d77 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] validate_networks() for [('279b0e6d-910d-4002-a8c0-bb7f28f694b8', None, None, None, None, None)] {{(pid=118526) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:12:59.049940 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4698c165-e384-4bbc-b85d-5478a75f83d2 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:59.052072 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-4698c165-e384-4bbc-b85d-5478a75f83d2 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:59.066920 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4698c165-e384-4bbc-b85d-5478a75f83d2 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:59.068281 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4698c165-e384-4bbc-b85d-5478a75f83d2 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:59.069756 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4698c165-e384-4bbc-b85d-5478a75f83d2 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:59.070627 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4698c165-e384-4bbc-b85d-5478a75f83d2 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:59.132461 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-697e89e6-ce23-40f5-ab97-4e2c1bd89d77 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Flavor limits 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:12:59.136421 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-697e89e6-ce23-40f5-ab97-4e2c1bd89d77 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Image limits 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:12:59.137684 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-697e89e6-ce23-40f5-ab97-4e2c1bd89d77 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Flavor pref 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:12:59.138357 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-697e89e6-ce23-40f5-ab97-4e2c1bd89d77 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Image pref 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:12:59.138993 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-697e89e6-ce23-40f5-ab97-4e2c1bd89d77 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:12:59.172535 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-697e89e6-ce23-40f5-ab97-4e2c1bd89d77 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:59.172698 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-697e89e6-ce23-40f5-ab97-4e2c1bd89d77 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:59.179784 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-697e89e6-ce23-40f5-ab97-4e2c1bd89d77 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:59.181338 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-697e89e6-ce23-40f5-ab97-4e2c1bd89d77 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:59.210068 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-4698c165-e384-4bbc-b85d-5478a75f83d2 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:59.225827 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-4698c165-e384-4bbc-b85d-5478a75f83d2 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1299 microversion: 2.1 time: 0.181895 Aug 02 09:12:59.229088 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 131/264] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:59 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1299 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:12:59.247859 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=2 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:12:59.290836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-697e89e6-ce23-40f5-ab97-4e2c1bd89d77 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Getting quotas for project 5b01727cea94442bb62b56e7a4ae57a0. Resources: {'cores', 'ram', 'instances'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:12:59.311968 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-a4a90159-4d74-4301-9850-b42786ae34df tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:59.319763 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-a4a90159-4d74-4301-9850-b42786ae34df tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:59.326912 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-697e89e6-ce23-40f5-ab97-4e2c1bd89d77 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Getting quotas for user 1eda94767d1547fa82f6407a4c7de1d8 and project 5b01727cea94442bb62b56e7a4ae57a0. Resources: {'cores', 'ram', 'instances'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:12:59.345126 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a4a90159-4d74-4301-9850-b42786ae34df tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:59.346422 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a4a90159-4d74-4301-9850-b42786ae34df tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:59.351156 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a4a90159-4d74-4301-9850-b42786ae34df tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:12:59.353708 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a4a90159-4d74-4301-9850-b42786ae34df tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:12:59.401076 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-697e89e6-ce23-40f5-ab97-4e2c1bd89d77 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Going to run 1 instances... {{(pid=118526) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:12:59.422825 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-697e89e6-ce23-40f5-ab97-4e2c1bd89d77 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7a52f4c5-c531-494a-b375-4f6dce3abbc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:12:59.815671 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-697e89e6-ce23-40f5-ab97-4e2c1bd89d77 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.745043 Aug 02 09:12:59.827628 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 134/265] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 2 09:12:58 2022] POST /compute/v2.1/servers => generated 409 bytes in 1758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:12:59.850149 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-36b95b54-096d-4b3c-a384-e3b880b731e0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:12:59.850597 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-36b95b54-096d-4b3c-a384-e3b880b731e0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:12:59.885835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-a4a90159-4d74-4301-9850-b42786ae34df tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:59.901018 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-a4a90159-4d74-4301-9850-b42786ae34df tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:59.902791 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-a4a90159-4d74-4301-9850-b42786ae34df tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:59.904610 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-a4a90159-4d74-4301-9850-b42786ae34df tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1739 microversion: 2.20 time: 0.600937 Aug 02 09:12:59.905597 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 132/266] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:12:59 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1739 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:12:59.961517 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-36b95b54-096d-4b3c-a384-e3b880b731e0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:12:59.970044 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-36b95b54-096d-4b3c-a384-e3b880b731e0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1245 microversion: 2.1 time: 0.135148 Aug 02 09:12:59.970964 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 135/267] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:12:59 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1245 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:00.282365 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d93a623b-077a-4afd-9b29-0eee8574127d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:00.283317 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-d93a623b-077a-4afd-9b29-0eee8574127d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:00.311053 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d93a623b-077a-4afd-9b29-0eee8574127d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:00.311542 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d93a623b-077a-4afd-9b29-0eee8574127d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:00.312503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d93a623b-077a-4afd-9b29-0eee8574127d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:00.313607 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d93a623b-077a-4afd-9b29-0eee8574127d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:00.319149 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=100 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:00.598057 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d93a623b-077a-4afd-9b29-0eee8574127d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:00.614076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-d93a623b-077a-4afd-9b29-0eee8574127d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1367 microversion: 2.1 time: 0.361954 Aug 02 09:13:00.615169 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 133/268] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:00 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1367 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:00.957808 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-92d6fb53-d5bf-43ee-91c9-a918cbcca00f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:00.959551 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-92d6fb53-d5bf-43ee-91c9-a918cbcca00f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:00.969255 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-92d6fb53-d5bf-43ee-91c9-a918cbcca00f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:00.969935 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-92d6fb53-d5bf-43ee-91c9-a918cbcca00f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:00.970847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-92d6fb53-d5bf-43ee-91c9-a918cbcca00f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:00.972140 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-92d6fb53-d5bf-43ee-91c9-a918cbcca00f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:01.002217 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-fb8cfc5b-5eb6-42dc-bfab-93f9b7e0609a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:01.005918 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-fb8cfc5b-5eb6-42dc-bfab-93f9b7e0609a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:01.185801 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-fb8cfc5b-5eb6-42dc-bfab-93f9b7e0609a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:01.196707 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-fb8cfc5b-5eb6-42dc-bfab-93f9b7e0609a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1245 microversion: 2.1 time: 0.200074 Aug 02 09:13:01.234650 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 134/269] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:00 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1245 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:01.262856 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-92d6fb53-d5bf-43ee-91c9-a918cbcca00f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:01.274440 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-92d6fb53-d5bf-43ee-91c9-a918cbcca00f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:01.278838 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-92d6fb53-d5bf-43ee-91c9-a918cbcca00f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:01.282286 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-92d6fb53-d5bf-43ee-91c9-a918cbcca00f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1739 microversion: 2.20 time: 0.348043 Aug 02 09:13:01.283165 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 136/270] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:00 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1739 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:01.651539 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-088b2822-b681-4d84-9b07-4605e433bcde tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:01.652181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-088b2822-b681-4d84-9b07-4605e433bcde tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:01.660386 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-088b2822-b681-4d84-9b07-4605e433bcde tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:01.661246 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-088b2822-b681-4d84-9b07-4605e433bcde tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:01.662329 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-088b2822-b681-4d84-9b07-4605e433bcde tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:01.663093 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-088b2822-b681-4d84-9b07-4605e433bcde tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:02.230926 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-447de45a-bd92-4b60-aeca-5089016ed4a6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:02.236653 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-447de45a-bd92-4b60-aeca-5089016ed4a6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:02.474052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-088b2822-b681-4d84-9b07-4605e433bcde tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:02.480675 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-447de45a-bd92-4b60-aeca-5089016ed4a6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:02.492981 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-088b2822-b681-4d84-9b07-4605e433bcde tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1367 microversion: 2.1 time: 0.838752 Aug 02 09:13:02.493941 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 135/271] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:01 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1367 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:02.503206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-447de45a-bd92-4b60-aeca-5089016ed4a6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1245 microversion: 2.1 time: 0.272490 Aug 02 09:13:02.503206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 137/272] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:02 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1245 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:02.542107 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-4f4eddc0-d38b-4315-b7da-c04ba01b1fd9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:02.543966 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-4f4eddc0-d38b-4315-b7da-c04ba01b1fd9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:02.599774 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4f4eddc0-d38b-4315-b7da-c04ba01b1fd9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:02.606219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4f4eddc0-d38b-4315-b7da-c04ba01b1fd9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:02.607813 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4f4eddc0-d38b-4315-b7da-c04ba01b1fd9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:02.608321 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4f4eddc0-d38b-4315-b7da-c04ba01b1fd9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:02.626469 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-fc80760b-3d2e-46c2-b308-1b371e8f0284 req-5ec187c0-02e0-47a5-9d4d-0353f35e530b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cc9a7eb-eb1a-4b92-a548-da35114c2912", "tag": "6d274d23-5313-4f79-b83a-3fd7fc8e216c"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:02.689033 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-fc80760b-3d2e-46c2-b308-1b371e8f0284 req-5ec187c0-02e0-47a5-9d4d-0353f35e530b service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:02.690623 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-fc80760b-3d2e-46c2-b308-1b371e8f0284 req-5ec187c0-02e0-47a5-9d4d-0353f35e530b service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:02.734343 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-fc80760b-3d2e-46c2-b308-1b371e8f0284 req-5ec187c0-02e0-47a5-9d4d-0353f35e530b service nova] Creating event network-changed:6d274d23-5313-4f79-b83a-3fd7fc8e216c for instance 0cc9a7eb-eb1a-4b92-a548-da35114c2912 on hv-cinder-84599 Aug 02 09:13:02.748886 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-fc80760b-3d2e-46c2-b308-1b371e8f0284 req-5ec187c0-02e0-47a5-9d4d-0353f35e530b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124098 Aug 02 09:13:02.750417 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 136/273] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:13:02.997045 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-4f4eddc0-d38b-4315-b7da-c04ba01b1fd9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:03.033113 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-4f4eddc0-d38b-4315-b7da-c04ba01b1fd9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:03.035501 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-4f4eddc0-d38b-4315-b7da-c04ba01b1fd9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:03.036792 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-4f4eddc0-d38b-4315-b7da-c04ba01b1fd9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1739 microversion: 2.20 time: 0.517259 Aug 02 09:13:03.040354 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 138/274] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:02 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1739 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:03.520626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-7d0d958e-1e24-410d-9f64-1fb66a757d5a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:03.522409 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-7d0d958e-1e24-410d-9f64-1fb66a757d5a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:03.545342 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7d0d958e-1e24-410d-9f64-1fb66a757d5a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:03.546556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7d0d958e-1e24-410d-9f64-1fb66a757d5a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:03.547813 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7d0d958e-1e24-410d-9f64-1fb66a757d5a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:03.548510 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7d0d958e-1e24-410d-9f64-1fb66a757d5a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:03.551774 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-fe6cd7e4-04e7-4b62-9273-95c31cb99562 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:03.555755 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-fe6cd7e4-04e7-4b62-9273-95c31cb99562 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:03.592828 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fe6cd7e4-04e7-4b62-9273-95c31cb99562 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:03.594826 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fe6cd7e4-04e7-4b62-9273-95c31cb99562 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:03.598818 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fe6cd7e4-04e7-4b62-9273-95c31cb99562 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:03.599395 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fe6cd7e4-04e7-4b62-9273-95c31cb99562 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:03.695711 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=2 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:03.863033 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-fe6cd7e4-04e7-4b62-9273-95c31cb99562 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:03.880747 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-fe6cd7e4-04e7-4b62-9273-95c31cb99562 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1297 microversion: 2.1 time: 0.337023 Aug 02 09:13:03.897071 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 139/275] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:03 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1297 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:03.935177 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-7d0d958e-1e24-410d-9f64-1fb66a757d5a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:03.960100 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-7d0d958e-1e24-410d-9f64-1fb66a757d5a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1367 microversion: 2.1 time: 0.445057 Aug 02 09:13:03.967373 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 137/276] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:03 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1367 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:04.065910 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b7fb7483-7311-48bd-8672-e5743ff25a7d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:04.067736 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b7fb7483-7311-48bd-8672-e5743ff25a7d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:04.081257 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b7fb7483-7311-48bd-8672-e5743ff25a7d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:04.082205 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b7fb7483-7311-48bd-8672-e5743ff25a7d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:04.084447 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b7fb7483-7311-48bd-8672-e5743ff25a7d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:04.085134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b7fb7483-7311-48bd-8672-e5743ff25a7d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:04.365034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b7fb7483-7311-48bd-8672-e5743ff25a7d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:04.378417 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b7fb7483-7311-48bd-8672-e5743ff25a7d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:04.382025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b7fb7483-7311-48bd-8672-e5743ff25a7d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:04.399251 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b7fb7483-7311-48bd-8672-e5743ff25a7d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1739 microversion: 2.20 time: 0.323654 Aug 02 09:13:04.399251 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 140/277] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:04 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1739 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:04.914641 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-e00695d5-8029-4859-bf8d-b9d762c72944 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:04.917293 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-e00695d5-8029-4859-bf8d-b9d762c72944 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:04.932715 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e00695d5-8029-4859-bf8d-b9d762c72944 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:04.933565 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e00695d5-8029-4859-bf8d-b9d762c72944 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:04.934565 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e00695d5-8029-4859-bf8d-b9d762c72944 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:04.935209 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e00695d5-8029-4859-bf8d-b9d762c72944 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:05.001290 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-eb94ac4d-542b-4d5f-8b41-79b05621b157 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:05.001964 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-eb94ac4d-542b-4d5f-8b41-79b05621b157 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:05.009433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-eb94ac4d-542b-4d5f-8b41-79b05621b157 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:05.009968 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-eb94ac4d-542b-4d5f-8b41-79b05621b157 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:05.010851 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-eb94ac4d-542b-4d5f-8b41-79b05621b157 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:05.011438 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-eb94ac4d-542b-4d5f-8b41-79b05621b157 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:05.053282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-e00695d5-8029-4859-bf8d-b9d762c72944 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:05.062465 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-e00695d5-8029-4859-bf8d-b9d762c72944 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1305 microversion: 2.1 time: 0.153250 Aug 02 09:13:05.080302 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 138/278] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:04 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1305 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:05.319615 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-eb94ac4d-542b-4d5f-8b41-79b05621b157 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:05.330593 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-eb94ac4d-542b-4d5f-8b41-79b05621b157 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1367 microversion: 2.1 time: 0.334141 Aug 02 09:13:05.331580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 141/279] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:04 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1367 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:05.423714 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-327195ee-992d-4c73-ae81-0fec6d78ae39 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:05.424864 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-327195ee-992d-4c73-ae81-0fec6d78ae39 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:05.431962 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-327195ee-992d-4c73-ae81-0fec6d78ae39 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:05.432450 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-327195ee-992d-4c73-ae81-0fec6d78ae39 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:05.433268 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-327195ee-992d-4c73-ae81-0fec6d78ae39 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:05.433693 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-327195ee-992d-4c73-ae81-0fec6d78ae39 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:06.056083 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-327195ee-992d-4c73-ae81-0fec6d78ae39 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:06.081985 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-327195ee-992d-4c73-ae81-0fec6d78ae39 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:06.094026 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-46489980-99e7-4274-a66e-f46c76f005de tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:06.097162 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-327195ee-992d-4c73-ae81-0fec6d78ae39 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:06.098150 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-46489980-99e7-4274-a66e-f46c76f005de tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:06.103307 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-327195ee-992d-4c73-ae81-0fec6d78ae39 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1739 microversion: 2.20 time: 0.685094 Aug 02 09:13:06.129279 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 139/280] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:05 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1739 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:06.150830 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-46489980-99e7-4274-a66e-f46c76f005de tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:06.151911 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-46489980-99e7-4274-a66e-f46c76f005de tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:06.153283 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-46489980-99e7-4274-a66e-f46c76f005de tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:06.154050 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-46489980-99e7-4274-a66e-f46c76f005de tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:06.364632 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-21467a0e-a7cf-4049-bbb9-7286b4f919a7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:06.365423 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-21467a0e-a7cf-4049-bbb9-7286b4f919a7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:06.376478 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-21467a0e-a7cf-4049-bbb9-7286b4f919a7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:06.376971 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-21467a0e-a7cf-4049-bbb9-7286b4f919a7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:06.378380 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-21467a0e-a7cf-4049-bbb9-7286b4f919a7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:06.392468 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-21467a0e-a7cf-4049-bbb9-7286b4f919a7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:06.523429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-46489980-99e7-4274-a66e-f46c76f005de tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:06.533587 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-46489980-99e7-4274-a66e-f46c76f005de tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1305 microversion: 2.1 time: 0.447320 Aug 02 09:13:06.539996 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 142/281] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:06 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1305 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:06.730784 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-21467a0e-a7cf-4049-bbb9-7286b4f919a7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:06.743768 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-21467a0e-a7cf-4049-bbb9-7286b4f919a7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1367 microversion: 2.1 time: 0.383964 Aug 02 09:13:06.744992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 140/282] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:06 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1367 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:07.159368 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-3195c68d-e702-4b2e-aa94-5679fd68bcf8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:07.160796 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-3195c68d-e702-4b2e-aa94-5679fd68bcf8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:07.168074 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3195c68d-e702-4b2e-aa94-5679fd68bcf8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:07.168640 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3195c68d-e702-4b2e-aa94-5679fd68bcf8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:07.169377 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3195c68d-e702-4b2e-aa94-5679fd68bcf8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:07.175897 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3195c68d-e702-4b2e-aa94-5679fd68bcf8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:07.559402 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-9cc3f009-17a4-477f-998f-3dcf1eaae513 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:07.561274 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-9cc3f009-17a4-477f-998f-3dcf1eaae513 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:07.590333 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9cc3f009-17a4-477f-998f-3dcf1eaae513 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:07.590957 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9cc3f009-17a4-477f-998f-3dcf1eaae513 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:07.591900 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9cc3f009-17a4-477f-998f-3dcf1eaae513 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:07.592443 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9cc3f009-17a4-477f-998f-3dcf1eaae513 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:07.664286 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-3195c68d-e702-4b2e-aa94-5679fd68bcf8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:07.683834 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-3195c68d-e702-4b2e-aa94-5679fd68bcf8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:07.691779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-3195c68d-e702-4b2e-aa94-5679fd68bcf8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:07.714023 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-3195c68d-e702-4b2e-aa94-5679fd68bcf8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1739 microversion: 2.20 time: 0.562643 Aug 02 09:13:07.717415 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 143/283] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:07 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1739 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:07.755784 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-9cc3f009-17a4-477f-998f-3dcf1eaae513 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:07.767066 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-9cc3f009-17a4-477f-998f-3dcf1eaae513 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1303 microversion: 2.1 time: 0.214601 Aug 02 09:13:07.770193 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-63036ae4-cf0f-4389-b839-a31719d96637 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:07.770853 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-63036ae4-cf0f-4389-b839-a31719d96637 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:07.778270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 141/284] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:07 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1303 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:07.781274 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-63036ae4-cf0f-4389-b839-a31719d96637 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:07.781799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-63036ae4-cf0f-4389-b839-a31719d96637 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:07.782807 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-63036ae4-cf0f-4389-b839-a31719d96637 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:07.783244 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-63036ae4-cf0f-4389-b839-a31719d96637 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:08.051568 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-63036ae4-cf0f-4389-b839-a31719d96637 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:08.066617 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-63036ae4-cf0f-4389-b839-a31719d96637 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1367 microversion: 2.1 time: 0.301275 Aug 02 09:13:08.067755 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 144/285] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:07 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:08.742320 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-886b37d8-774b-4d0f-9be5-bc539eb04190 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:08.742993 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-886b37d8-774b-4d0f-9be5-bc539eb04190 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:08.769203 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-886b37d8-774b-4d0f-9be5-bc539eb04190 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:08.783296 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-886b37d8-774b-4d0f-9be5-bc539eb04190 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:08.783296 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-886b37d8-774b-4d0f-9be5-bc539eb04190 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:08.783296 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-886b37d8-774b-4d0f-9be5-bc539eb04190 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:08.799230 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a32fbb89-01fb-4875-851b-54bf3f288ce5 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:08.799230 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-a32fbb89-01fb-4875-851b-54bf3f288ce5 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:08.813660 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a32fbb89-01fb-4875-851b-54bf3f288ce5 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:08.817558 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a32fbb89-01fb-4875-851b-54bf3f288ce5 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:08.818716 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a32fbb89-01fb-4875-851b-54bf3f288ce5 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:08.819359 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a32fbb89-01fb-4875-851b-54bf3f288ce5 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:09.213033 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=2 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:09.331520 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-886b37d8-774b-4d0f-9be5-bc539eb04190 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:09.354300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-a32fbb89-01fb-4875-851b-54bf3f288ce5 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:09.360829 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-886b37d8-774b-4d0f-9be5-bc539eb04190 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:09.363358 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-886b37d8-774b-4d0f-9be5-bc539eb04190 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:09.367102 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-a32fbb89-01fb-4875-851b-54bf3f288ce5 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1371 microversion: 2.1 time: 0.573880 Aug 02 09:13:09.368529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-886b37d8-774b-4d0f-9be5-bc539eb04190 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1739 microversion: 2.20 time: 0.632586 Aug 02 09:13:09.371341 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 142/286] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:08 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1739 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:09.372447 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 145/287] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:08 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1371 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:09.377925 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-0ea36e70-ab3e-4890-89da-9737a20061b4 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:09.382989 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-0ea36e70-ab3e-4890-89da-9737a20061b4 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:09.402259 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0ea36e70-ab3e-4890-89da-9737a20061b4 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:09.402940 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0ea36e70-ab3e-4890-89da-9737a20061b4 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:09.404196 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0ea36e70-ab3e-4890-89da-9737a20061b4 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:09.404867 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0ea36e70-ab3e-4890-89da-9737a20061b4 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:09.779182 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-0ea36e70-ab3e-4890-89da-9737a20061b4 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:09.811758 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-0ea36e70-ab3e-4890-89da-9737a20061b4 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1367 microversion: 2.1 time: 0.436396 Aug 02 09:13:09.813976 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 143/288] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:09 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1367 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:10.087074 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-084704c4-8176-424a-aaf5-9b3c054cdd92 req-5d1f2f7d-9864-4217-9b94-46f8e9fcd317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc9a7eb-eb1a-4b92-a548-da35114c2912", "name": "network-vif-plugged", "status": "completed", "tag": "6d274d23-5313-4f79-b83a-3fd7fc8e216c"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:10.110685 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-084704c4-8176-424a-aaf5-9b3c054cdd92 req-5d1f2f7d-9864-4217-9b94-46f8e9fcd317 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:10.118540 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-084704c4-8176-424a-aaf5-9b3c054cdd92 req-5d1f2f7d-9864-4217-9b94-46f8e9fcd317 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:10.152091 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-084704c4-8176-424a-aaf5-9b3c054cdd92 req-5d1f2f7d-9864-4217-9b94-46f8e9fcd317 service nova] Creating event network-vif-plugged:6d274d23-5313-4f79-b83a-3fd7fc8e216c for instance 0cc9a7eb-eb1a-4b92-a548-da35114c2912 on hv-cinder-84599 Aug 02 09:13:10.163753 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-084704c4-8176-424a-aaf5-9b3c054cdd92 req-5d1f2f7d-9864-4217-9b94-46f8e9fcd317 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080369 Aug 02 09:13:10.169750 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 146/289] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:10.425388 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-56a2dc59-6795-4001-ae4c-99d9983194ea tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:10.426063 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-56a2dc59-6795-4001-ae4c-99d9983194ea tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:10.428068 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-0989f9e0-a896-41f6-8482-eac5f040816c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:10.429089 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-0989f9e0-a896-41f6-8482-eac5f040816c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:10.434868 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-56a2dc59-6795-4001-ae4c-99d9983194ea tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:10.435334 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-56a2dc59-6795-4001-ae4c-99d9983194ea tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:10.436102 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-56a2dc59-6795-4001-ae4c-99d9983194ea tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:10.436572 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-56a2dc59-6795-4001-ae4c-99d9983194ea tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:10.437408 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0989f9e0-a896-41f6-8482-eac5f040816c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:10.438015 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0989f9e0-a896-41f6-8482-eac5f040816c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:10.441186 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0989f9e0-a896-41f6-8482-eac5f040816c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:10.441788 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0989f9e0-a896-41f6-8482-eac5f040816c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:10.900433 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-56a2dc59-6795-4001-ae4c-99d9983194ea tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:10.907225 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-0989f9e0-a896-41f6-8482-eac5f040816c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:10.919084 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-0989f9e0-a896-41f6-8482-eac5f040816c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1371 microversion: 2.1 time: 0.496107 Aug 02 09:13:10.920325 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 147/290] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:10 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1371 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:10.926408 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-ca5dd45e-acfc-4e9e-9efd-b37e93bd02d3 req-31fe45f2-7cdf-46d4-b42b-58bebedafae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "351f0943-3d4a-43c0-a57d-2e0bdda1fc4d", "tag": "7fd2e01d-97ab-4034-89c5-5069ee9e9915"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:10.960723 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-ca5dd45e-acfc-4e9e-9efd-b37e93bd02d3 req-31fe45f2-7cdf-46d4-b42b-58bebedafae3 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:10.961461 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-ca5dd45e-acfc-4e9e-9efd-b37e93bd02d3 req-31fe45f2-7cdf-46d4-b42b-58bebedafae3 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:10.970139 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-56a2dc59-6795-4001-ae4c-99d9983194ea tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:10.976399 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-56a2dc59-6795-4001-ae4c-99d9983194ea tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:10.979814 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-56a2dc59-6795-4001-ae4c-99d9983194ea tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1739 microversion: 2.20 time: 0.558962 Aug 02 09:13:10.981037 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 144/291] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:10 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1739 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:10.999159 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-ca5dd45e-acfc-4e9e-9efd-b37e93bd02d3 req-31fe45f2-7cdf-46d4-b42b-58bebedafae3 service nova] Creating event network-changed:7fd2e01d-97ab-4034-89c5-5069ee9e9915 for instance 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d on hv-cinder-84599 Aug 02 09:13:11.005626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-c203347e-5066-4517-937e-b1bc74345b63 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:11.009148 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-c203347e-5066-4517-937e-b1bc74345b63 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:11.014094 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-ca5dd45e-acfc-4e9e-9efd-b37e93bd02d3 req-31fe45f2-7cdf-46d4-b42b-58bebedafae3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092296 Aug 02 09:13:11.033732 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 148/292] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:11.051227 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c203347e-5066-4517-937e-b1bc74345b63 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:11.051661 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c203347e-5066-4517-937e-b1bc74345b63 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:11.057045 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c203347e-5066-4517-937e-b1bc74345b63 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:11.057494 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c203347e-5066-4517-937e-b1bc74345b63 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:11.196518 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=12 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:11.262353 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-c203347e-5066-4517-937e-b1bc74345b63 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:11.281922 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-c203347e-5066-4517-937e-b1bc74345b63 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1367 microversion: 2.1 time: 0.296473 Aug 02 09:13:11.282634 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 145/293] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:10 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:11.964780 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-ddf63a33-9157-4f11-9996-b8eab97b2701 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:11.965698 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-ddf63a33-9157-4f11-9996-b8eab97b2701 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:11.973050 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ddf63a33-9157-4f11-9996-b8eab97b2701 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:11.973503 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ddf63a33-9157-4f11-9996-b8eab97b2701 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:11.974310 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ddf63a33-9157-4f11-9996-b8eab97b2701 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:11.974751 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ddf63a33-9157-4f11-9996-b8eab97b2701 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:12.016448 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-1f316a66-204d-4807-9235-1740fc31a228 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:12.016448 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-1f316a66-204d-4807-9235-1740fc31a228 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:12.017094 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=4 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:12.026395 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1f316a66-204d-4807-9235-1740fc31a228 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:12.026395 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1f316a66-204d-4807-9235-1740fc31a228 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:12.026395 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1f316a66-204d-4807-9235-1740fc31a228 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:12.035024 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1f316a66-204d-4807-9235-1740fc31a228 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:12.262262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-ddf63a33-9157-4f11-9996-b8eab97b2701 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:12.272548 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-ddf63a33-9157-4f11-9996-b8eab97b2701 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1371 microversion: 2.1 time: 0.312180 Aug 02 09:13:12.273798 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 149/294] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:11 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1371 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:12.306681 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-fe43e4d5-bebb-45d0-8da4-571bdffc766d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:12.307408 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-fe43e4d5-bebb-45d0-8da4-571bdffc766d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:12.316147 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fe43e4d5-bebb-45d0-8da4-571bdffc766d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:12.316744 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fe43e4d5-bebb-45d0-8da4-571bdffc766d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:12.317909 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fe43e4d5-bebb-45d0-8da4-571bdffc766d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:12.318776 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fe43e4d5-bebb-45d0-8da4-571bdffc766d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:12.326413 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-1f316a66-204d-4807-9235-1740fc31a228 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:12.343544 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-1f316a66-204d-4807-9235-1740fc31a228 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:12.351773 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-1f316a66-204d-4807-9235-1740fc31a228 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:12.361078 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-1f316a66-204d-4807-9235-1740fc31a228 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1739 microversion: 2.20 time: 0.352219 Aug 02 09:13:12.363742 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 146/295] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:12 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1739 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:12.490175 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=22 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:12.612481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-fe43e4d5-bebb-45d0-8da4-571bdffc766d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:12.621649 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-fe43e4d5-bebb-45d0-8da4-571bdffc766d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1367 microversion: 2.1 time: 0.320280 Aug 02 09:13:12.633395 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 150/296] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:12 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:13.304928 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-7813a1dd-4c62-4f51-adda-f19489deb3ba tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:13.306615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-7813a1dd-4c62-4f51-adda-f19489deb3ba tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:13.332224 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7813a1dd-4c62-4f51-adda-f19489deb3ba tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:13.338904 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7813a1dd-4c62-4f51-adda-f19489deb3ba tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:13.340014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7813a1dd-4c62-4f51-adda-f19489deb3ba tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:13.346728 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7813a1dd-4c62-4f51-adda-f19489deb3ba tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:13.389894 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-207f1a86-e115-4a1e-bdbc-4a2898693220 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:13.391553 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-207f1a86-e115-4a1e-bdbc-4a2898693220 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:13.415334 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-207f1a86-e115-4a1e-bdbc-4a2898693220 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:13.418719 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-207f1a86-e115-4a1e-bdbc-4a2898693220 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:13.423237 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-207f1a86-e115-4a1e-bdbc-4a2898693220 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:13.427097 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-207f1a86-e115-4a1e-bdbc-4a2898693220 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:14.175909 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-7813a1dd-4c62-4f51-adda-f19489deb3ba tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:14.186205 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-7813a1dd-4c62-4f51-adda-f19489deb3ba tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1371 microversion: 2.1 time: 0.886906 Aug 02 09:13:14.187268 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 147/297] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:13 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1371 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:14.195378 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-524e3397-8960-4647-ba30-b9d9b3142872 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:14.196336 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-524e3397-8960-4647-ba30-b9d9b3142872 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:14.204902 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-524e3397-8960-4647-ba30-b9d9b3142872 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:14.206464 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-524e3397-8960-4647-ba30-b9d9b3142872 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:14.207582 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-524e3397-8960-4647-ba30-b9d9b3142872 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:14.208625 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-524e3397-8960-4647-ba30-b9d9b3142872 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:14.219614 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-207f1a86-e115-4a1e-bdbc-4a2898693220 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:14.237146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-207f1a86-e115-4a1e-bdbc-4a2898693220 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:14.240406 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-207f1a86-e115-4a1e-bdbc-4a2898693220 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:14.242924 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-207f1a86-e115-4a1e-bdbc-4a2898693220 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1739 microversion: 2.20 time: 0.857225 Aug 02 09:13:14.264923 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 151/298] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:13 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1739 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:13:14.538015 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-524e3397-8960-4647-ba30-b9d9b3142872 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:14.545596 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-524e3397-8960-4647-ba30-b9d9b3142872 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1367 microversion: 2.1 time: 0.357119 Aug 02 09:13:14.546244 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 148/299] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:14 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1367 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:15.226001 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-cc51e246-4dab-4f7b-965f-76efe81dd5d3 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:15.226627 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-cc51e246-4dab-4f7b-965f-76efe81dd5d3 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:15.233010 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cc51e246-4dab-4f7b-965f-76efe81dd5d3 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:15.233463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cc51e246-4dab-4f7b-965f-76efe81dd5d3 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:15.234245 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cc51e246-4dab-4f7b-965f-76efe81dd5d3 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:15.234697 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cc51e246-4dab-4f7b-965f-76efe81dd5d3 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:15.251174 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=100 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:15.290849 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-0c26b930-21c4-4f5e-9c87-4b439c3977c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:15.293300 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-0c26b930-21c4-4f5e-9c87-4b439c3977c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:15.335500 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0c26b930-21c4-4f5e-9c87-4b439c3977c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:15.341812 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0c26b930-21c4-4f5e-9c87-4b439c3977c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:15.350988 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0c26b930-21c4-4f5e-9c87-4b439c3977c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:15.350988 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0c26b930-21c4-4f5e-9c87-4b439c3977c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:15.598825 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-cc51e246-4dab-4f7b-965f-76efe81dd5d3 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:15.619117 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-cc51e246-4dab-4f7b-965f-76efe81dd5d3 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1371 microversion: 2.1 time: 0.397831 Aug 02 09:13:15.620547 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 152/300] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:15 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1371 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:15.629371 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-96e7b331-b09d-42c7-9782-d0184763d24d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:15.630974 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-96e7b331-b09d-42c7-9782-d0184763d24d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:15.652402 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-96e7b331-b09d-42c7-9782-d0184763d24d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:15.652402 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-96e7b331-b09d-42c7-9782-d0184763d24d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:15.652402 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-96e7b331-b09d-42c7-9782-d0184763d24d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:15.652402 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-96e7b331-b09d-42c7-9782-d0184763d24d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:15.653077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-0c26b930-21c4-4f5e-9c87-4b439c3977c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:15.669405 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-0c26b930-21c4-4f5e-9c87-4b439c3977c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:15.671061 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-0c26b930-21c4-4f5e-9c87-4b439c3977c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:15.672300 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-0c26b930-21c4-4f5e-9c87-4b439c3977c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1739 microversion: 2.20 time: 0.387790 Aug 02 09:13:15.682839 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 149/301] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:15 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1739 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:15.846318 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-96e7b331-b09d-42c7-9782-d0184763d24d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:15.855172 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-96e7b331-b09d-42c7-9782-d0184763d24d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1367 microversion: 2.1 time: 0.233231 Aug 02 09:13:15.857485 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 153/302] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:15 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:16.643574 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-6cca96ac-9473-4227-b906-4379cf47c5ac tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:16.645707 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-6cca96ac-9473-4227-b906-4379cf47c5ac tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:16.652800 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6cca96ac-9473-4227-b906-4379cf47c5ac tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:16.653277 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6cca96ac-9473-4227-b906-4379cf47c5ac tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:16.654220 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6cca96ac-9473-4227-b906-4379cf47c5ac tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:16.654735 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6cca96ac-9473-4227-b906-4379cf47c5ac tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:16.703709 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-101a3d56-cb07-446a-b03e-e9fbf5f25a03 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:16.706048 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-101a3d56-cb07-446a-b03e-e9fbf5f25a03 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:16.720601 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-101a3d56-cb07-446a-b03e-e9fbf5f25a03 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:16.721571 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-101a3d56-cb07-446a-b03e-e9fbf5f25a03 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:16.722701 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-101a3d56-cb07-446a-b03e-e9fbf5f25a03 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:16.723443 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-101a3d56-cb07-446a-b03e-e9fbf5f25a03 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:16.904571 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-6cca96ac-9473-4227-b906-4379cf47c5ac tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:16.915690 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-6cca96ac-9473-4227-b906-4379cf47c5ac tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1371 microversion: 2.1 time: 0.276911 Aug 02 09:13:16.916315 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 150/303] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:16 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1371 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:16.923519 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-98b2de55-17a3-467e-ab94-708be7ac2acf tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:16.924946 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-98b2de55-17a3-467e-ab94-708be7ac2acf tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:16.935970 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-98b2de55-17a3-467e-ab94-708be7ac2acf tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:16.937583 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-98b2de55-17a3-467e-ab94-708be7ac2acf tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:16.939428 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-98b2de55-17a3-467e-ab94-708be7ac2acf tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:16.942498 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-98b2de55-17a3-467e-ab94-708be7ac2acf tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:16.967083 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-101a3d56-cb07-446a-b03e-e9fbf5f25a03 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:16.968361 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=100 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:16.986081 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-101a3d56-cb07-446a-b03e-e9fbf5f25a03 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:16.989728 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-101a3d56-cb07-446a-b03e-e9fbf5f25a03 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:16.992118 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-101a3d56-cb07-446a-b03e-e9fbf5f25a03 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1721 microversion: 2.20 time: 0.297499 Aug 02 09:13:16.993274 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 154/304] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:16 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1721 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:13:17.113888 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-98b2de55-17a3-467e-ab94-708be7ac2acf tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:17.122576 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-98b2de55-17a3-467e-ab94-708be7ac2acf tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1558 microversion: 2.1 time: 0.203004 Aug 02 09:13:17.124819 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 151/305] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:16 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1558 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:17.145979 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-2bbc69fe-aa60-408b-832a-4a637cff619a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:17.146563 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-2bbc69fe-aa60-408b-832a-4a637cff619a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:17.153244 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2bbc69fe-aa60-408b-832a-4a637cff619a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:17.153668 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2bbc69fe-aa60-408b-832a-4a637cff619a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:17.154605 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2bbc69fe-aa60-408b-832a-4a637cff619a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:17.155049 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2bbc69fe-aa60-408b-832a-4a637cff619a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:17.272050 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-2bbc69fe-aa60-408b-832a-4a637cff619a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.130337 Aug 02 09:13:17.275355 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 155/306] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Aug 2 09:13:17 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:17.939114 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-8566696c-2535-4094-9715-e8b84386194c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:17.939985 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-8566696c-2535-4094-9715-e8b84386194c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:17.947141 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8566696c-2535-4094-9715-e8b84386194c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:17.947918 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8566696c-2535-4094-9715-e8b84386194c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:17.948751 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8566696c-2535-4094-9715-e8b84386194c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:17.949199 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8566696c-2535-4094-9715-e8b84386194c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:18.042356 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-5c88d6b6-4c21-4eea-adcb-4a5b1f867ae4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:18.043194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-5c88d6b6-4c21-4eea-adcb-4a5b1f867ae4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:18.055828 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5c88d6b6-4c21-4eea-adcb-4a5b1f867ae4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:18.056408 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5c88d6b6-4c21-4eea-adcb-4a5b1f867ae4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:18.062570 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5c88d6b6-4c21-4eea-adcb-4a5b1f867ae4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:18.063104 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5c88d6b6-4c21-4eea-adcb-4a5b1f867ae4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:18.215683 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-8566696c-2535-4094-9715-e8b84386194c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:18.232130 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-8566696c-2535-4094-9715-e8b84386194c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1371 microversion: 2.1 time: 0.296987 Aug 02 09:13:18.249059 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 152/307] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:17 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1371 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:18.305013 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-5c88d6b6-4c21-4eea-adcb-4a5b1f867ae4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:18.314200 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-5c88d6b6-4c21-4eea-adcb-4a5b1f867ae4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:18.317114 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-5c88d6b6-4c21-4eea-adcb-4a5b1f867ae4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:18.318788 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-5c88d6b6-4c21-4eea-adcb-4a5b1f867ae4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1721 microversion: 2.20 time: 0.283050 Aug 02 09:13:18.326886 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 156/308] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:18 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1721 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:13:18.767119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-acb6d5a9-41b6-401b-afa0-7e60e2101533 req-7c5d1e00-1fa7-4f9e-837c-e05cb0a97705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cc9a7eb-eb1a-4b92-a548-da35114c2912", "tag": "6d274d23-5313-4f79-b83a-3fd7fc8e216c"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:18.786855 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-acb6d5a9-41b6-401b-afa0-7e60e2101533 req-7c5d1e00-1fa7-4f9e-837c-e05cb0a97705 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:18.787738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-acb6d5a9-41b6-401b-afa0-7e60e2101533 req-7c5d1e00-1fa7-4f9e-837c-e05cb0a97705 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:18.808335 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-acb6d5a9-41b6-401b-afa0-7e60e2101533 req-7c5d1e00-1fa7-4f9e-837c-e05cb0a97705 service nova] Creating event network-changed:6d274d23-5313-4f79-b83a-3fd7fc8e216c for instance 0cc9a7eb-eb1a-4b92-a548-da35114c2912 on hv-cinder-84599 Aug 02 09:13:18.820611 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-acb6d5a9-41b6-401b-afa0-7e60e2101533 req-7c5d1e00-1fa7-4f9e-837c-e05cb0a97705 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054774 Aug 02 09:13:18.820611 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 153/309] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:19.235836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-cf749f97-fbb8-4711-b52d-b675ad925173 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-888344094", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-425466987", "security_groups": [{"name": "tempest-secgroup-smoke-1943259117"}], "networks": [{"uuid": "698ddb73-46d6-4c7c-9943-958bb061c701"}], "block_device_mapping_v2": [{"uuid": "b5dcc056-7d4f-4d32-92fc-b7d978831e5c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:19.276246 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-e21506f8-e3e2-4837-b74c-9530f53c8597 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:19.287645 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-e21506f8-e3e2-4837-b74c-9530f53c8597 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:19.308607 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e21506f8-e3e2-4837-b74c-9530f53c8597 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:19.309107 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e21506f8-e3e2-4837-b74c-9530f53c8597 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:19.310011 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e21506f8-e3e2-4837-b74c-9530f53c8597 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:19.311487 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e21506f8-e3e2-4837-b74c-9530f53c8597 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:19.571294 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.network.neutron [None req-cf749f97-fbb8-4711-b52d-b675ad925173 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] validate_networks() for [('698ddb73-46d6-4c7c-9943-958bb061c701', None, None, None, None, None)] {{(pid=118526) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:13:19.672991 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-e21506f8-e3e2-4837-b74c-9530f53c8597 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:19.695344 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-e21506f8-e3e2-4837-b74c-9530f53c8597 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1371 microversion: 2.1 time: 0.426917 Aug 02 09:13:19.698778 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 154/310] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:19 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1371 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:19.723337 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-3ddb65df-ee45-4214-9c2c-0bded059f91e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:19.725479 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-3ddb65df-ee45-4214-9c2c-0bded059f91e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:19.741695 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3ddb65df-ee45-4214-9c2c-0bded059f91e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:19.742894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3ddb65df-ee45-4214-9c2c-0bded059f91e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:19.744431 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3ddb65df-ee45-4214-9c2c-0bded059f91e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:19.748258 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3ddb65df-ee45-4214-9c2c-0bded059f91e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:20.148086 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-3ddb65df-ee45-4214-9c2c-0bded059f91e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:20.163726 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-3ddb65df-ee45-4214-9c2c-0bded059f91e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:20.166721 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-3ddb65df-ee45-4214-9c2c-0bded059f91e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:20.168302 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-3ddb65df-ee45-4214-9c2c-0bded059f91e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1721 microversion: 2.20 time: 0.467442 Aug 02 09:13:20.169068 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 155/311] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:19 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1721 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:20.378112 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-cf749f97-fbb8-4711-b52d-b675ad925173 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Flavor limits 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:13:20.378112 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-cf749f97-fbb8-4711-b52d-b675ad925173 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Image limits 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:13:20.381133 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-cf749f97-fbb8-4711-b52d-b675ad925173 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Flavor pref 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:13:20.383463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-cf749f97-fbb8-4711-b52d-b675ad925173 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Image pref 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:13:20.384007 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-cf749f97-fbb8-4711-b52d-b675ad925173 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:13:20.405607 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cf749f97-fbb8-4711-b52d-b675ad925173 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:20.409330 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cf749f97-fbb8-4711-b52d-b675ad925173 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:20.410881 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cf749f97-fbb8-4711-b52d-b675ad925173 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:20.416021 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cf749f97-fbb8-4711-b52d-b675ad925173 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:20.439826 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-cf749f97-fbb8-4711-b52d-b675ad925173 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Getting quotas for project ebb47864b5694d2e85b1d90eb2c809bc. Resources: {'cores', 'ram', 'instances'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:13:20.447828 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-cf749f97-fbb8-4711-b52d-b675ad925173 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Getting quotas for user 75559881115047eeb72554769404ed0a and project ebb47864b5694d2e85b1d90eb2c809bc. Resources: {'cores', 'ram', 'instances'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:13:20.635779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-cf749f97-fbb8-4711-b52d-b675ad925173 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Going to run 1 instances... {{(pid=118526) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:13:20.637980 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-cf749f97-fbb8-4711-b52d-b675ad925173 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b5dcc056-7d4f-4d32-92fc-b7d978831e5c',volume_size=None,volume_type=None)] {{(pid=118526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:13:20.755963 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-b44f2780-c770-49e4-9f20-4d2d51e97012 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:20.755963 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-b44f2780-c770-49e4-9f20-4d2d51e97012 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:20.762023 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b44f2780-c770-49e4-9f20-4d2d51e97012 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:20.762726 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b44f2780-c770-49e4-9f20-4d2d51e97012 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:20.765178 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b44f2780-c770-49e4-9f20-4d2d51e97012 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:20.765924 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b44f2780-c770-49e4-9f20-4d2d51e97012 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:20.965237 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-b44f2780-c770-49e4-9f20-4d2d51e97012 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:20.973777 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-b44f2780-c770-49e4-9f20-4d2d51e97012 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1371 microversion: 2.1 time: 0.237708 Aug 02 09:13:20.976800 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 156/312] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:20 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:20.982488 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-3c46d8ba-6461-41e8-8751-de4c79686c10 req-57e37e33-7e00-47fc-9ec0-9fee9f39750c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cca7c83-368d-4c02-a00c-d12a84825c27", "name": "network-vif-unplugged", "status": "completed", "tag": "8f442acd-437f-4082-97ec-7f28749a0a8b"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:20.993438 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-3c46d8ba-6461-41e8-8751-de4c79686c10 req-57e37e33-7e00-47fc-9ec0-9fee9f39750c service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:20.993873 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-3c46d8ba-6461-41e8-8751-de4c79686c10 req-57e37e33-7e00-47fc-9ec0-9fee9f39750c service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:21.007055 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-3c46d8ba-6461-41e8-8751-de4c79686c10 req-57e37e33-7e00-47fc-9ec0-9fee9f39750c service nova] Creating event network-vif-unplugged:8f442acd-437f-4082-97ec-7f28749a0a8b for instance 6cca7c83-368d-4c02-a00c-d12a84825c27 on hv-cinder-84599 Aug 02 09:13:21.012718 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-3c46d8ba-6461-41e8-8751-de4c79686c10 req-57e37e33-7e00-47fc-9ec0-9fee9f39750c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034160 Aug 02 09:13:21.013201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 157/313] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:21.201040 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-64f2c373-12a1-4a40-ba54-0aaf3fbfebed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:21.201740 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-64f2c373-12a1-4a40-ba54-0aaf3fbfebed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:21.208861 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-64f2c373-12a1-4a40-ba54-0aaf3fbfebed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:21.209233 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-64f2c373-12a1-4a40-ba54-0aaf3fbfebed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:21.210024 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-64f2c373-12a1-4a40-ba54-0aaf3fbfebed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:21.210453 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-64f2c373-12a1-4a40-ba54-0aaf3fbfebed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:21.413454 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-cf749f97-fbb8-4711-b52d-b675ad925173 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.185474 Aug 02 09:13:21.414693 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 157/314] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 2 09:13:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 2188 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:13:21.434196 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-d04f65d7-506e-4bbf-a78e-c16088c95923 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:21.438911 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-d04f65d7-506e-4bbf-a78e-c16088c95923 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:21.573158 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-d04f65d7-506e-4bbf-a78e-c16088c95923 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:21.588334 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-d04f65d7-506e-4bbf-a78e-c16088c95923 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1087 microversion: 2.1 time: 0.166149 Aug 02 09:13:21.601895 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 158/315] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:21 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1087 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:21.688383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-64f2c373-12a1-4a40-ba54-0aaf3fbfebed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:21.698921 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-64f2c373-12a1-4a40-ba54-0aaf3fbfebed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:21.700776 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-64f2c373-12a1-4a40-ba54-0aaf3fbfebed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:21.702324 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-64f2c373-12a1-4a40-ba54-0aaf3fbfebed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1721 microversion: 2.20 time: 0.505743 Aug 02 09:13:21.712044 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 158/316] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:21 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1721 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:13:21.995718 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-545ba714-eb8b-4b90-9b16-9d8e0188f3e0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:21.996501 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-545ba714-eb8b-4b90-9b16-9d8e0188f3e0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:22.003358 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-545ba714-eb8b-4b90-9b16-9d8e0188f3e0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:22.004134 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-545ba714-eb8b-4b90-9b16-9d8e0188f3e0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:22.005045 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-545ba714-eb8b-4b90-9b16-9d8e0188f3e0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:22.005605 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-545ba714-eb8b-4b90-9b16-9d8e0188f3e0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:22.169427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-545ba714-eb8b-4b90-9b16-9d8e0188f3e0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:22.178137 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-545ba714-eb8b-4b90-9b16-9d8e0188f3e0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1371 microversion: 2.1 time: 0.186984 Aug 02 09:13:22.178707 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 159/317] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:21 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:22.608599 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-00b7ccdd-eb3b-47fc-9ae1-022eabe4a07d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:22.609352 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-00b7ccdd-eb3b-47fc-9ae1-022eabe4a07d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:22.681897 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-00b7ccdd-eb3b-47fc-9ae1-022eabe4a07d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:22.689318 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-00b7ccdd-eb3b-47fc-9ae1-022eabe4a07d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1087 microversion: 2.1 time: 0.084497 Aug 02 09:13:22.699608 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 159/318] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:22 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1087 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:22.729165 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a49820c2-1100-4184-a368-b1b891c70e9b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:22.729855 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-a49820c2-1100-4184-a368-b1b891c70e9b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:22.736297 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a49820c2-1100-4184-a368-b1b891c70e9b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:22.736763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a49820c2-1100-4184-a368-b1b891c70e9b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:22.737604 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a49820c2-1100-4184-a368-b1b891c70e9b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:22.738053 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a49820c2-1100-4184-a368-b1b891c70e9b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:22.916049 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-a49820c2-1100-4184-a368-b1b891c70e9b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:22.929319 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-a49820c2-1100-4184-a368-b1b891c70e9b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:22.931086 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-a49820c2-1100-4184-a368-b1b891c70e9b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:22.932623 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-a49820c2-1100-4184-a368-b1b891c70e9b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1724 microversion: 2.20 time: 0.208503 Aug 02 09:13:22.934018 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 160/319] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:22 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:22.957240 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d3597bc9-1605-41d4-b36d-8e95ff027b16 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "02d010d8-9863-4d0e-8ab2-2cbc8c1fe2e9"}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:22.959902 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-d3597bc9-1605-41d4-b36d-8e95ff027b16 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:22.971166 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d3597bc9-1605-41d4-b36d-8e95ff027b16 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:22.972147 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d3597bc9-1605-41d4-b36d-8e95ff027b16 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:22.973636 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d3597bc9-1605-41d4-b36d-8e95ff027b16 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:22.974769 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d3597bc9-1605-41d4-b36d-8e95ff027b16 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:23.029991 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-529e8af9-2693-42f8-9d11-0c0c87b0bb41 req-9a3b69aa-8c13-489f-9218-46f979266097 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "351f0943-3d4a-43c0-a57d-2e0bdda1fc4d", "name": "network-vif-plugged", "status": "completed", "tag": "7fd2e01d-97ab-4034-89c5-5069ee9e9915"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:23.041844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-529e8af9-2693-42f8-9d11-0c0c87b0bb41 req-9a3b69aa-8c13-489f-9218-46f979266097 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:23.042603 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-529e8af9-2693-42f8-9d11-0c0c87b0bb41 req-9a3b69aa-8c13-489f-9218-46f979266097 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:23.055809 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-529e8af9-2693-42f8-9d11-0c0c87b0bb41 req-9a3b69aa-8c13-489f-9218-46f979266097 service nova] Creating event network-vif-plugged:7fd2e01d-97ab-4034-89c5-5069ee9e9915 for instance 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d on hv-cinder-84599 Aug 02 09:13:23.061989 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-529e8af9-2693-42f8-9d11-0c0c87b0bb41 req-9a3b69aa-8c13-489f-9218-46f979266097 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035913 Aug 02 09:13:23.062959 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 161/320] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:13:23.202377 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-90e2795b-3239-4bcf-86a1-5caa0509d075 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:23.204498 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-90e2795b-3239-4bcf-86a1-5caa0509d075 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:23.212343 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-90e2795b-3239-4bcf-86a1-5caa0509d075 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:23.212793 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-90e2795b-3239-4bcf-86a1-5caa0509d075 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:23.213573 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-90e2795b-3239-4bcf-86a1-5caa0509d075 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:23.214015 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-90e2795b-3239-4bcf-86a1-5caa0509d075 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:23.374932 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-90e2795b-3239-4bcf-86a1-5caa0509d075 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:23.384462 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-90e2795b-3239-4bcf-86a1-5caa0509d075 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1371 microversion: 2.1 time: 0.187493 Aug 02 09:13:23.390438 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 162/321] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:23 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:23.714217 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-7dc658ca-e374-42c0-b6a1-888dc06852b9 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:23.715101 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-7dc658ca-e374-42c0-b6a1-888dc06852b9 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:23.723300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7dc658ca-e374-42c0-b6a1-888dc06852b9 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:23.723823 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7dc658ca-e374-42c0-b6a1-888dc06852b9 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:23.724717 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7dc658ca-e374-42c0-b6a1-888dc06852b9 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:23.725153 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7dc658ca-e374-42c0-b6a1-888dc06852b9 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:23.794777 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-7dc658ca-e374-42c0-b6a1-888dc06852b9 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:23.802936 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-7dc658ca-e374-42c0-b6a1-888dc06852b9 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1129 microversion: 2.1 time: 0.094356 Aug 02 09:13:23.803606 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 163/322] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:23 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1129 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:24.407409 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-076533b8-29d9-4727-a4ad-bad83b0c7b40 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:24.407938 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-076533b8-29d9-4727-a4ad-bad83b0c7b40 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:24.414794 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-076533b8-29d9-4727-a4ad-bad83b0c7b40 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:24.415249 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-076533b8-29d9-4727-a4ad-bad83b0c7b40 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:24.416147 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-076533b8-29d9-4727-a4ad-bad83b0c7b40 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:24.416612 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-076533b8-29d9-4727-a4ad-bad83b0c7b40 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:24.481041 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-d3597bc9-1605-41d4-b36d-8e95ff027b16 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "POST /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.528339 Aug 02 09:13:24.482789 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 160/323] 10.222.0.20 () {62 vars in 1364 bytes} [Tue Aug 2 09:13:22 2022] POST /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27/os-volume_attachments => generated 188 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 02 09:13:24.570899 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-076533b8-29d9-4727-a4ad-bad83b0c7b40 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:24.579405 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-076533b8-29d9-4727-a4ad-bad83b0c7b40 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1371 microversion: 2.1 time: 0.175944 Aug 02 09:13:24.580843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 164/324] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:24 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1371 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:24.636130 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-bdc43277-7786-4c79-a367-7d126a6dc1c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:24.636760 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-bdc43277-7786-4c79-a367-7d126a6dc1c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:24.645006 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bdc43277-7786-4c79-a367-7d126a6dc1c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:24.645463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bdc43277-7786-4c79-a367-7d126a6dc1c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:24.646479 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bdc43277-7786-4c79-a367-7d126a6dc1c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:24.646917 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bdc43277-7786-4c79-a367-7d126a6dc1c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:24.693954 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-bdc43277-7786-4c79-a367-7d126a6dc1c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118525) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 09:13:24.829180 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-4efc8030-1803-47ca-91f6-0d28048da0d7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:24.829928 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-4efc8030-1803-47ca-91f6-0d28048da0d7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:24.839444 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4efc8030-1803-47ca-91f6-0d28048da0d7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:24.839905 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4efc8030-1803-47ca-91f6-0d28048da0d7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:24.840768 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4efc8030-1803-47ca-91f6-0d28048da0d7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:24.841390 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4efc8030-1803-47ca-91f6-0d28048da0d7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:24.953894 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-4efc8030-1803-47ca-91f6-0d28048da0d7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:24.962771 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-4efc8030-1803-47ca-91f6-0d28048da0d7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1185 microversion: 2.1 time: 0.140236 Aug 02 09:13:24.964377 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 165/325] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:24 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1185 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:25.130110 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-bdc43277-7786-4c79-a367-7d126a6dc1c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "POST /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27/action" status: 202 len: 0 microversion: 2.20 time: 0.498020 Aug 02 09:13:25.131904 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 161/326] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Aug 2 09:13:24 2022] POST /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27/action => generated 0 bytes in 500 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:13:25.153042 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-638a7487-e5e3-40fb-8dcd-37b51553e97f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:25.153750 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-638a7487-e5e3-40fb-8dcd-37b51553e97f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:25.162793 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-638a7487-e5e3-40fb-8dcd-37b51553e97f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:25.163351 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-638a7487-e5e3-40fb-8dcd-37b51553e97f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:25.164245 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-638a7487-e5e3-40fb-8dcd-37b51553e97f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:25.164988 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-638a7487-e5e3-40fb-8dcd-37b51553e97f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:25.353109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-638a7487-e5e3-40fb-8dcd-37b51553e97f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:25.364558 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-638a7487-e5e3-40fb-8dcd-37b51553e97f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:25.366384 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-638a7487-e5e3-40fb-8dcd-37b51553e97f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:25.367671 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-638a7487-e5e3-40fb-8dcd-37b51553e97f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1750 microversion: 2.20 time: 0.230284 Aug 02 09:13:25.368254 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 166/327] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:25 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1750 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:13:25.619927 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-0d379142-04f3-4206-a639-890ff7d79946 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:25.621123 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-0d379142-04f3-4206-a639-890ff7d79946 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:25.633675 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0d379142-04f3-4206-a639-890ff7d79946 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:25.634784 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0d379142-04f3-4206-a639-890ff7d79946 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:25.636522 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0d379142-04f3-4206-a639-890ff7d79946 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:25.637256 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0d379142-04f3-4206-a639-890ff7d79946 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:25.923351 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-0d379142-04f3-4206-a639-890ff7d79946 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:25.935436 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-0d379142-04f3-4206-a639-890ff7d79946 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1564 microversion: 2.1 time: 0.323558 Aug 02 09:13:25.936257 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 162/328] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:25 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1564 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:25.962352 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-884c5807-c36f-457e-a895-7da4d97da025 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:25.963448 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-884c5807-c36f-457e-a895-7da4d97da025 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:25.972428 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-884c5807-c36f-457e-a895-7da4d97da025 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:25.973044 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-884c5807-c36f-457e-a895-7da4d97da025 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:25.974150 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-884c5807-c36f-457e-a895-7da4d97da025 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:25.974567 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-884c5807-c36f-457e-a895-7da4d97da025 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:26.012186 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-40773f87-0566-4018-9f23-09f75b5ced43 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:26.012739 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-40773f87-0566-4018-9f23-09f75b5ced43 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:26.021384 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-40773f87-0566-4018-9f23-09f75b5ced43 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:26.022134 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-40773f87-0566-4018-9f23-09f75b5ced43 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:26.023211 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-40773f87-0566-4018-9f23-09f75b5ced43 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:26.024109 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-40773f87-0566-4018-9f23-09f75b5ced43 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:26.145254 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-40773f87-0566-4018-9f23-09f75b5ced43 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:26.154511 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-40773f87-0566-4018-9f23-09f75b5ced43 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1203 microversion: 2.1 time: 0.171551 Aug 02 09:13:26.155721 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 163/329] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:25 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1203 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:26.162160 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-884c5807-c36f-457e-a895-7da4d97da025 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.207554 Aug 02 09:13:26.163293 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 167/330] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Aug 2 09:13:25 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d/os-interface => generated 284 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:26.406474 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-18201127-3276-475b-ad3a-faf531dd0de9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:26.407463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-18201127-3276-475b-ad3a-faf531dd0de9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:26.429041 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-18201127-3276-475b-ad3a-faf531dd0de9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:26.430518 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-18201127-3276-475b-ad3a-faf531dd0de9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:26.431591 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-18201127-3276-475b-ad3a-faf531dd0de9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:26.431591 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-18201127-3276-475b-ad3a-faf531dd0de9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:26.855620 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-18201127-3276-475b-ad3a-faf531dd0de9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:26.871935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-18201127-3276-475b-ad3a-faf531dd0de9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:26.871935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-18201127-3276-475b-ad3a-faf531dd0de9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:26.872313 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-18201127-3276-475b-ad3a-faf531dd0de9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1750 microversion: 2.20 time: 0.471263 Aug 02 09:13:26.876209 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 164/331] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:26 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1750 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:27.182876 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-54df4db1-b795-4c9a-bd6e-777659ff1232 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:27.183586 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-54df4db1-b795-4c9a-bd6e-777659ff1232 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:27.187080 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:27.194803 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-54df4db1-b795-4c9a-bd6e-777659ff1232 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:27.195364 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-54df4db1-b795-4c9a-bd6e-777659ff1232 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:27.196826 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-54df4db1-b795-4c9a-bd6e-777659ff1232 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:27.197645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-54df4db1-b795-4c9a-bd6e-777659ff1232 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:27.566274 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-54df4db1-b795-4c9a-bd6e-777659ff1232 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:27.590413 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-54df4db1-b795-4c9a-bd6e-777659ff1232 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1271 microversion: 2.1 time: 0.413937 Aug 02 09:13:27.591492 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 168/332] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:27 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1271 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:27.815974 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-72836b52-06e2-4ea7-8fb0-3c2959520d19 req-091396ae-4508-4df8-ab0c-11f76e9fe0bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "351f0943-3d4a-43c0-a57d-2e0bdda1fc4d", "tag": "7fd2e01d-97ab-4034-89c5-5069ee9e9915"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:27.842768 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-72836b52-06e2-4ea7-8fb0-3c2959520d19 req-091396ae-4508-4df8-ab0c-11f76e9fe0bf service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:27.843885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-72836b52-06e2-4ea7-8fb0-3c2959520d19 req-091396ae-4508-4df8-ab0c-11f76e9fe0bf service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:27.862354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-72836b52-06e2-4ea7-8fb0-3c2959520d19 req-091396ae-4508-4df8-ab0c-11f76e9fe0bf service nova] Creating event network-changed:7fd2e01d-97ab-4034-89c5-5069ee9e9915 for instance 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d on hv-cinder-84599 Aug 02 09:13:27.870399 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-72836b52-06e2-4ea7-8fb0-3c2959520d19 req-091396ae-4508-4df8-ab0c-11f76e9fe0bf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065387 Aug 02 09:13:27.871955 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 165/333] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:13:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:27.902166 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-05376da9-65df-424a-81fa-90a2f8ca51fe tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:27.902773 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-05376da9-65df-424a-81fa-90a2f8ca51fe tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:27.918054 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-05376da9-65df-424a-81fa-90a2f8ca51fe tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:27.927015 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-05376da9-65df-424a-81fa-90a2f8ca51fe tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:27.928321 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-05376da9-65df-424a-81fa-90a2f8ca51fe tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:27.929215 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-05376da9-65df-424a-81fa-90a2f8ca51fe tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:28.628464 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-05376da9-65df-424a-81fa-90a2f8ca51fe tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:28.644702 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-5f7544fe-404d-440a-86a1-67f0bce41abf tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:28.647325 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-5f7544fe-404d-440a-86a1-67f0bce41abf tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:28.657684 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-05376da9-65df-424a-81fa-90a2f8ca51fe tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:28.659336 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5f7544fe-404d-440a-86a1-67f0bce41abf tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:28.659571 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-05376da9-65df-424a-81fa-90a2f8ca51fe tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:28.662193 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5f7544fe-404d-440a-86a1-67f0bce41abf tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:28.662193 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5f7544fe-404d-440a-86a1-67f0bce41abf tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:28.662617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5f7544fe-404d-440a-86a1-67f0bce41abf tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:28.663510 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-05376da9-65df-424a-81fa-90a2f8ca51fe tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1750 microversion: 2.20 time: 0.765306 Aug 02 09:13:28.668536 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 169/334] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:27 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1750 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:29.012824 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-5f7544fe-404d-440a-86a1-67f0bce41abf tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:29.059330 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-5f7544fe-404d-440a-86a1-67f0bce41abf tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1259 microversion: 2.1 time: 0.436879 Aug 02 09:13:29.079924 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 166/335] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:28 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1259 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:29.640027 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-3e387012-147b-4180-9d3e-ed6d4e3df08d req-e852f053-4f2c-4ea8-ba47-ed1185142470 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c36b6524-980c-4f56-b1ad-e71536c08577", "tag": "541f0637-de44-45f3-b1dd-7b7924d55993"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:29.668033 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-3e387012-147b-4180-9d3e-ed6d4e3df08d req-e852f053-4f2c-4ea8-ba47-ed1185142470 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:29.669288 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-3e387012-147b-4180-9d3e-ed6d4e3df08d req-e852f053-4f2c-4ea8-ba47-ed1185142470 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:29.693241 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-b3cfbbc9-97e5-40c8-bbde-afe7d48dcc0b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:29.694436 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-b3cfbbc9-97e5-40c8-bbde-afe7d48dcc0b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:29.695973 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-3e387012-147b-4180-9d3e-ed6d4e3df08d req-e852f053-4f2c-4ea8-ba47-ed1185142470 service nova] Creating event network-changed:541f0637-de44-45f3-b1dd-7b7924d55993 for instance c36b6524-980c-4f56-b1ad-e71536c08577 on hv-cinder-84599 Aug 02 09:13:29.707038 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-3e387012-147b-4180-9d3e-ed6d4e3df08d req-e852f053-4f2c-4ea8-ba47-ed1185142470 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079911 Aug 02 09:13:29.707746 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b3cfbbc9-97e5-40c8-bbde-afe7d48dcc0b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:29.708557 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b3cfbbc9-97e5-40c8-bbde-afe7d48dcc0b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:29.709670 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 170/336] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:13:29.709986 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b3cfbbc9-97e5-40c8-bbde-afe7d48dcc0b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:29.710754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b3cfbbc9-97e5-40c8-bbde-afe7d48dcc0b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:29.744523 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:30.035319 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-b3cfbbc9-97e5-40c8-bbde-afe7d48dcc0b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:30.049409 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-b3cfbbc9-97e5-40c8-bbde-afe7d48dcc0b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:30.051550 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-b3cfbbc9-97e5-40c8-bbde-afe7d48dcc0b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:30.052860 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-b3cfbbc9-97e5-40c8-bbde-afe7d48dcc0b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1752 microversion: 2.20 time: 0.367688 Aug 02 09:13:30.053674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 167/337] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:29 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1752 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:30.106649 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-fc0b4a34-78c3-4591-b732-67e7276f35e7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:30.107646 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-fc0b4a34-78c3-4591-b732-67e7276f35e7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:30.116215 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fc0b4a34-78c3-4591-b732-67e7276f35e7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:30.117012 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fc0b4a34-78c3-4591-b732-67e7276f35e7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:30.118124 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fc0b4a34-78c3-4591-b732-67e7276f35e7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:30.118876 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fc0b4a34-78c3-4591-b732-67e7276f35e7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:30.427463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-fc0b4a34-78c3-4591-b732-67e7276f35e7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:30.431449 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=2 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:30.452060 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-fc0b4a34-78c3-4591-b732-67e7276f35e7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1259 microversion: 2.1 time: 0.349665 Aug 02 09:13:30.454002 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 171/338] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:30 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1259 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:31.098758 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-fc329140-0741-403e-af82-f87c727999bf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:31.099954 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-fc329140-0741-403e-af82-f87c727999bf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:31.114364 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fc329140-0741-403e-af82-f87c727999bf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:31.115161 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fc329140-0741-403e-af82-f87c727999bf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:31.116790 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fc329140-0741-403e-af82-f87c727999bf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:31.117572 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fc329140-0741-403e-af82-f87c727999bf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:31.368664 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-fc329140-0741-403e-af82-f87c727999bf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:31.379027 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-fc329140-0741-403e-af82-f87c727999bf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:31.381015 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-fc329140-0741-403e-af82-f87c727999bf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:31.382217 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-fc329140-0741-403e-af82-f87c727999bf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1808 microversion: 2.20 time: 0.291950 Aug 02 09:13:31.382921 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 168/339] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:31 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1808 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:31.490406 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-8b910b5c-e499-43d9-bd39-c1bf0e8b3e48 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:31.491211 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-8b910b5c-e499-43d9-bd39-c1bf0e8b3e48 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:31.499185 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-8b910b5c-e499-43d9-bd39-c1bf0e8b3e48 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:31.499646 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-8b910b5c-e499-43d9-bd39-c1bf0e8b3e48 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:31.500471 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-8b910b5c-e499-43d9-bd39-c1bf0e8b3e48 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:31.500901 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-8b910b5c-e499-43d9-bd39-c1bf0e8b3e48 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:31.577769 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=8 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:31.722197 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-8b910b5c-e499-43d9-bd39-c1bf0e8b3e48 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:31.725282 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=100 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:31.734757 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-8b910b5c-e499-43d9-bd39-c1bf0e8b3e48 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1259 microversion: 2.1 time: 0.249279 Aug 02 09:13:31.736141 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 172/340] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:31 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1259 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:32.406964 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-9a7d86f2-52c1-4a65-8a97-2d387c1df755 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:32.408126 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-9a7d86f2-52c1-4a65-8a97-2d387c1df755 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:32.415499 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9a7d86f2-52c1-4a65-8a97-2d387c1df755 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:32.415943 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9a7d86f2-52c1-4a65-8a97-2d387c1df755 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:32.416939 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9a7d86f2-52c1-4a65-8a97-2d387c1df755 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:32.417352 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9a7d86f2-52c1-4a65-8a97-2d387c1df755 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:32.615224 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-9a7d86f2-52c1-4a65-8a97-2d387c1df755 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:32.627359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-9a7d86f2-52c1-4a65-8a97-2d387c1df755 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:32.629203 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-9a7d86f2-52c1-4a65-8a97-2d387c1df755 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:32.630650 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-9a7d86f2-52c1-4a65-8a97-2d387c1df755 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1808 microversion: 2.20 time: 0.228306 Aug 02 09:13:32.631471 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 169/341] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:32 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:13:32.759977 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-0c8b5760-ebdf-433f-969e-efd5d79c14a0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:32.760914 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-0c8b5760-ebdf-433f-969e-efd5d79c14a0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:32.769087 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0c8b5760-ebdf-433f-969e-efd5d79c14a0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:32.769549 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0c8b5760-ebdf-433f-969e-efd5d79c14a0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:32.770371 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0c8b5760-ebdf-433f-969e-efd5d79c14a0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:32.770804 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0c8b5760-ebdf-433f-969e-efd5d79c14a0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:32.965944 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-0c8b5760-ebdf-433f-969e-efd5d79c14a0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:32.980503 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-0c8b5760-ebdf-433f-969e-efd5d79c14a0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1259 microversion: 2.1 time: 0.224422 Aug 02 09:13:32.981705 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 173/342] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:32 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1259 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:33.449054 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ee236502-970a-4c94-ba3d-2b395cdfc01e tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:33.451162 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ee236502-970a-4c94-ba3d-2b395cdfc01e tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:33.457518 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=2 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:33.466559 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ee236502-970a-4c94-ba3d-2b395cdfc01e tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:33.467737 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ee236502-970a-4c94-ba3d-2b395cdfc01e tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:33.469681 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ee236502-970a-4c94-ba3d-2b395cdfc01e tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:33.471061 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ee236502-970a-4c94-ba3d-2b395cdfc01e tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:33.535292 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ee236502-970a-4c94-ba3d-2b395cdfc01e tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb/ips" status: 200 len: 143 microversion: 2.1 time: 0.093570 Aug 02 09:13:33.537423 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 170/343] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 2 09:13:33 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb/ips => generated 143 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:33.661854 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-1c08f68f-3a4f-4321-bd0a-59f752998f53 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:33.662881 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-1c08f68f-3a4f-4321-bd0a-59f752998f53 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:33.670565 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1c08f68f-3a4f-4321-bd0a-59f752998f53 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:33.671027 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1c08f68f-3a4f-4321-bd0a-59f752998f53 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:33.671950 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1c08f68f-3a4f-4321-bd0a-59f752998f53 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:33.672464 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1c08f68f-3a4f-4321-bd0a-59f752998f53 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:33.862746 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-1c08f68f-3a4f-4321-bd0a-59f752998f53 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:33.873591 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-1c08f68f-3a4f-4321-bd0a-59f752998f53 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:33.876360 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-1c08f68f-3a4f-4321-bd0a-59f752998f53 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:33.877912 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-1c08f68f-3a4f-4321-bd0a-59f752998f53 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1808 microversion: 2.20 time: 0.222993 Aug 02 09:13:33.878829 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 174/344] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:33 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:34.003817 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-09878a4f-7e63-43b8-8250-e04fc2e5edbb tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:34.004373 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-09878a4f-7e63-43b8-8250-e04fc2e5edbb tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:34.014019 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-09878a4f-7e63-43b8-8250-e04fc2e5edbb tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:34.016951 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-09878a4f-7e63-43b8-8250-e04fc2e5edbb tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:34.018863 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-09878a4f-7e63-43b8-8250-e04fc2e5edbb tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:34.019694 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-09878a4f-7e63-43b8-8250-e04fc2e5edbb tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:34.212266 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-09878a4f-7e63-43b8-8250-e04fc2e5edbb tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:34.222008 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-09878a4f-7e63-43b8-8250-e04fc2e5edbb tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1259 microversion: 2.1 time: 0.222307 Aug 02 09:13:34.222605 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 171/345] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:33 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1259 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:34.907659 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b735ed02-b15d-42af-90b4-2c13cf7bd529 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:34.909278 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b735ed02-b15d-42af-90b4-2c13cf7bd529 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:34.916929 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b735ed02-b15d-42af-90b4-2c13cf7bd529 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:34.917674 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b735ed02-b15d-42af-90b4-2c13cf7bd529 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:34.918636 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b735ed02-b15d-42af-90b4-2c13cf7bd529 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:34.919241 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b735ed02-b15d-42af-90b4-2c13cf7bd529 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:35.074510 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b735ed02-b15d-42af-90b4-2c13cf7bd529 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:35.084852 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b735ed02-b15d-42af-90b4-2c13cf7bd529 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:35.086418 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b735ed02-b15d-42af-90b4-2c13cf7bd529 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:35.087699 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b735ed02-b15d-42af-90b4-2c13cf7bd529 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1808 microversion: 2.20 time: 0.184581 Aug 02 09:13:35.088748 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 175/346] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:34 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:35.246635 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-fa453b80-7422-4f15-b44f-54d05d6df1c0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:35.247347 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-fa453b80-7422-4f15-b44f-54d05d6df1c0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:35.256707 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fa453b80-7422-4f15-b44f-54d05d6df1c0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:35.257448 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fa453b80-7422-4f15-b44f-54d05d6df1c0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:35.258258 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fa453b80-7422-4f15-b44f-54d05d6df1c0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:35.258732 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fa453b80-7422-4f15-b44f-54d05d6df1c0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:35.455868 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-fa453b80-7422-4f15-b44f-54d05d6df1c0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:35.465618 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-fa453b80-7422-4f15-b44f-54d05d6df1c0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1259 microversion: 2.1 time: 0.223820 Aug 02 09:13:35.466408 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 172/347] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:35 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1259 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:36.113424 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c2a06a3c-81e3-48e5-ae69-7a69b3e338f1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:36.114179 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-c2a06a3c-81e3-48e5-ae69-7a69b3e338f1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:36.123148 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c2a06a3c-81e3-48e5-ae69-7a69b3e338f1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:36.123148 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c2a06a3c-81e3-48e5-ae69-7a69b3e338f1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:36.123148 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c2a06a3c-81e3-48e5-ae69-7a69b3e338f1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:36.123148 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c2a06a3c-81e3-48e5-ae69-7a69b3e338f1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:36.274212 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-c2a06a3c-81e3-48e5-ae69-7a69b3e338f1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:36.283055 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-c2a06a3c-81e3-48e5-ae69-7a69b3e338f1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:36.284881 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-c2a06a3c-81e3-48e5-ae69-7a69b3e338f1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:36.286133 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-c2a06a3c-81e3-48e5-ae69-7a69b3e338f1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1808 microversion: 2.20 time: 0.177390 Aug 02 09:13:36.286735 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 176/348] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:36 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:36.494205 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d5f26a81-639e-41d1-8c77-79a3912dbb62 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:36.496535 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-d5f26a81-639e-41d1-8c77-79a3912dbb62 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:36.509680 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d5f26a81-639e-41d1-8c77-79a3912dbb62 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:36.510462 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d5f26a81-639e-41d1-8c77-79a3912dbb62 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:36.511843 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d5f26a81-639e-41d1-8c77-79a3912dbb62 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:36.512687 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d5f26a81-639e-41d1-8c77-79a3912dbb62 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:36.700217 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d5f26a81-639e-41d1-8c77-79a3912dbb62 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:36.709445 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-d5f26a81-639e-41d1-8c77-79a3912dbb62 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1259 microversion: 2.1 time: 0.220628 Aug 02 09:13:36.710424 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 173/349] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:36 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1259 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:37.314187 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-325d1a1e-fda9-4b73-a43e-0cc80b4c4bcd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:37.315217 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-325d1a1e-fda9-4b73-a43e-0cc80b4c4bcd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:37.322993 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-325d1a1e-fda9-4b73-a43e-0cc80b4c4bcd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:37.323244 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-325d1a1e-fda9-4b73-a43e-0cc80b4c4bcd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:37.323983 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-325d1a1e-fda9-4b73-a43e-0cc80b4c4bcd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:37.324570 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-325d1a1e-fda9-4b73-a43e-0cc80b4c4bcd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:37.521424 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-325d1a1e-fda9-4b73-a43e-0cc80b4c4bcd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:37.535436 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-325d1a1e-fda9-4b73-a43e-0cc80b4c4bcd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:37.537434 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-325d1a1e-fda9-4b73-a43e-0cc80b4c4bcd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:37.538951 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-325d1a1e-fda9-4b73-a43e-0cc80b4c4bcd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1808 microversion: 2.20 time: 0.230303 Aug 02 09:13:37.539737 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 177/350] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:37 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:37.732247 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d256887c-f1d2-40d2-a956-4abae5e681d0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:37.732871 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-d256887c-f1d2-40d2-a956-4abae5e681d0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:37.740284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d256887c-f1d2-40d2-a956-4abae5e681d0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:37.740727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d256887c-f1d2-40d2-a956-4abae5e681d0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:37.741560 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d256887c-f1d2-40d2-a956-4abae5e681d0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:37.741987 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d256887c-f1d2-40d2-a956-4abae5e681d0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:37.933294 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d256887c-f1d2-40d2-a956-4abae5e681d0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:37.944372 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-d256887c-f1d2-40d2-a956-4abae5e681d0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1259 microversion: 2.1 time: 0.216252 Aug 02 09:13:37.945442 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 174/351] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:37 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1259 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:38.569425 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-78355024-5286-4bfd-8da7-6afb3c0f6040 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:38.570853 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-78355024-5286-4bfd-8da7-6afb3c0f6040 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:38.579219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-78355024-5286-4bfd-8da7-6afb3c0f6040 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:38.580935 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-78355024-5286-4bfd-8da7-6afb3c0f6040 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:38.581887 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-78355024-5286-4bfd-8da7-6afb3c0f6040 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:38.582431 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-78355024-5286-4bfd-8da7-6afb3c0f6040 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:38.746885 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-78355024-5286-4bfd-8da7-6afb3c0f6040 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:38.764822 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-78355024-5286-4bfd-8da7-6afb3c0f6040 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:38.770795 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-78355024-5286-4bfd-8da7-6afb3c0f6040 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:38.770795 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-78355024-5286-4bfd-8da7-6afb3c0f6040 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1808 microversion: 2.20 time: 0.208658 Aug 02 09:13:38.770795 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 178/352] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:38 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:38.981075 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-e641fb7d-6f6c-43ad-9e06-7cb9c6005ca7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:38.994440 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-e641fb7d-6f6c-43ad-9e06-7cb9c6005ca7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:38.994440 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e641fb7d-6f6c-43ad-9e06-7cb9c6005ca7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:38.994440 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e641fb7d-6f6c-43ad-9e06-7cb9c6005ca7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:38.994440 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e641fb7d-6f6c-43ad-9e06-7cb9c6005ca7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:38.994836 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e641fb7d-6f6c-43ad-9e06-7cb9c6005ca7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:39.169095 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-e641fb7d-6f6c-43ad-9e06-7cb9c6005ca7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:39.179179 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-e641fb7d-6f6c-43ad-9e06-7cb9c6005ca7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1259 microversion: 2.1 time: 0.206094 Aug 02 09:13:39.180070 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 175/353] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:38 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1259 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:39.412873 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-7c9ffe7f-677e-434d-8732-3afc9dd32fb1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d789b6ff-110a-48c0-867a-b2ab1dcf2eef"}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:39.415291 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-7c9ffe7f-677e-434d-8732-3afc9dd32fb1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:39.421554 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7c9ffe7f-677e-434d-8732-3afc9dd32fb1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:39.422852 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7c9ffe7f-677e-434d-8732-3afc9dd32fb1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:39.422852 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7c9ffe7f-677e-434d-8732-3afc9dd32fb1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:39.423846 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7c9ffe7f-677e-434d-8732-3afc9dd32fb1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:39.798432 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-13f1b834-2a98-414e-ae4d-be8da41af4c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:39.800335 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-13f1b834-2a98-414e-ae4d-be8da41af4c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:39.809841 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-13f1b834-2a98-414e-ae4d-be8da41af4c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:39.811248 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-13f1b834-2a98-414e-ae4d-be8da41af4c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:39.813311 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-13f1b834-2a98-414e-ae4d-be8da41af4c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:39.815327 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-13f1b834-2a98-414e-ae4d-be8da41af4c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:39.988095 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-13f1b834-2a98-414e-ae4d-be8da41af4c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:39.997785 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-13f1b834-2a98-414e-ae4d-be8da41af4c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:39.999493 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-13f1b834-2a98-414e-ae4d-be8da41af4c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:40.000907 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-13f1b834-2a98-414e-ae4d-be8da41af4c5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1808 microversion: 2.20 time: 0.211591 Aug 02 09:13:40.002168 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 176/354] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:39 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:13:40.212780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-3ed1d716-0e90-4136-b8d6-c50c7bd601a4 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:40.213945 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-3ed1d716-0e90-4136-b8d6-c50c7bd601a4 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:40.222195 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3ed1d716-0e90-4136-b8d6-c50c7bd601a4 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:40.222948 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3ed1d716-0e90-4136-b8d6-c50c7bd601a4 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:40.223933 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3ed1d716-0e90-4136-b8d6-c50c7bd601a4 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:40.224401 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3ed1d716-0e90-4136-b8d6-c50c7bd601a4 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:40.425782 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-3ed1d716-0e90-4136-b8d6-c50c7bd601a4 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:40.435364 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-3ed1d716-0e90-4136-b8d6-c50c7bd601a4 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1259 microversion: 2.1 time: 0.227557 Aug 02 09:13:40.444959 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 177/355] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:40 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1259 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:41.029540 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-1ddfb7fd-0943-4ac0-964a-09af672b2478 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:41.031799 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-1ddfb7fd-0943-4ac0-964a-09af672b2478 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:41.043363 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1ddfb7fd-0943-4ac0-964a-09af672b2478 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:41.044182 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1ddfb7fd-0943-4ac0-964a-09af672b2478 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:41.045585 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1ddfb7fd-0943-4ac0-964a-09af672b2478 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:41.046361 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1ddfb7fd-0943-4ac0-964a-09af672b2478 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:41.243938 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-1ddfb7fd-0943-4ac0-964a-09af672b2478 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:41.254225 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-1ddfb7fd-0943-4ac0-964a-09af672b2478 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:41.255844 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-1ddfb7fd-0943-4ac0-964a-09af672b2478 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:41.257045 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-1ddfb7fd-0943-4ac0-964a-09af672b2478 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1808 microversion: 2.20 time: 0.234559 Aug 02 09:13:41.257621 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 178/356] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:41 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:13:41.463277 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-7033b9ec-26bf-460d-ad47-b82244d401b5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:41.464180 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-7033b9ec-26bf-460d-ad47-b82244d401b5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:41.472317 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7033b9ec-26bf-460d-ad47-b82244d401b5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:41.472842 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7033b9ec-26bf-460d-ad47-b82244d401b5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:41.473549 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7033b9ec-26bf-460d-ad47-b82244d401b5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:41.474016 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7033b9ec-26bf-460d-ad47-b82244d401b5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:41.654736 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-7033b9ec-26bf-460d-ad47-b82244d401b5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:41.672335 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-7033b9ec-26bf-460d-ad47-b82244d401b5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1259 microversion: 2.1 time: 0.212853 Aug 02 09:13:41.672942 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 179/357] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:41 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1259 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:42.284450 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-1bf86405-008f-44ec-a38a-2fd694f5f314 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:42.285444 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-1bf86405-008f-44ec-a38a-2fd694f5f314 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:42.297131 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1bf86405-008f-44ec-a38a-2fd694f5f314 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:42.297827 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1bf86405-008f-44ec-a38a-2fd694f5f314 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:42.299407 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1bf86405-008f-44ec-a38a-2fd694f5f314 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:42.300017 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1bf86405-008f-44ec-a38a-2fd694f5f314 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:42.535275 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-1bf86405-008f-44ec-a38a-2fd694f5f314 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:42.546160 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-1bf86405-008f-44ec-a38a-2fd694f5f314 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:42.548609 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-1bf86405-008f-44ec-a38a-2fd694f5f314 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:42.550470 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-1bf86405-008f-44ec-a38a-2fd694f5f314 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1808 microversion: 2.20 time: 0.270248 Aug 02 09:13:42.552397 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 180/358] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:42 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1808 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:42.711084 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4df5f36d-03b4-44f2-bdec-3d37c649da16 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:42.711690 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-4df5f36d-03b4-44f2-bdec-3d37c649da16 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:42.722816 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4df5f36d-03b4-44f2-bdec-3d37c649da16 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:42.726176 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4df5f36d-03b4-44f2-bdec-3d37c649da16 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:42.726176 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4df5f36d-03b4-44f2-bdec-3d37c649da16 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:42.727220 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4df5f36d-03b4-44f2-bdec-3d37c649da16 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:43.029246 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-4df5f36d-03b4-44f2-bdec-3d37c649da16 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:43.047308 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-4df5f36d-03b4-44f2-bdec-3d37c649da16 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1259 microversion: 2.1 time: 0.340566 Aug 02 09:13:43.049767 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 181/359] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:42 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1259 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:43.577085 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ab383ecf-ff6f-4930-ba40-1deef68c3bc5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:43.578088 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ab383ecf-ff6f-4930-ba40-1deef68c3bc5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:43.580968 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:43.589571 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ab383ecf-ff6f-4930-ba40-1deef68c3bc5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:43.590019 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ab383ecf-ff6f-4930-ba40-1deef68c3bc5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:43.590834 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ab383ecf-ff6f-4930-ba40-1deef68c3bc5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:43.591270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ab383ecf-ff6f-4930-ba40-1deef68c3bc5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:43.761942 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ab383ecf-ff6f-4930-ba40-1deef68c3bc5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:43.771686 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ab383ecf-ff6f-4930-ba40-1deef68c3bc5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:43.773243 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ab383ecf-ff6f-4930-ba40-1deef68c3bc5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:43.774425 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ab383ecf-ff6f-4930-ba40-1deef68c3bc5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1808 microversion: 2.20 time: 0.201609 Aug 02 09:13:43.774988 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 182/360] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:43 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:13:44.083798 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-061f81ca-40ca-4e9c-927c-c2f12ceabb7c tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:44.084442 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-061f81ca-40ca-4e9c-927c-c2f12ceabb7c tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:44.090933 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-061f81ca-40ca-4e9c-927c-c2f12ceabb7c tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:44.091383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-061f81ca-40ca-4e9c-927c-c2f12ceabb7c tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:44.092175 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-061f81ca-40ca-4e9c-927c-c2f12ceabb7c tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:44.092617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-061f81ca-40ca-4e9c-927c-c2f12ceabb7c tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:44.245207 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-061f81ca-40ca-4e9c-927c-c2f12ceabb7c tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:44.254229 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-061f81ca-40ca-4e9c-927c-c2f12ceabb7c tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1259 microversion: 2.1 time: 0.175631 Aug 02 09:13:44.254817 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 183/361] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:44 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:44.802695 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-cc33ce25-8094-428f-adc4-fc7b3e0aaad7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:44.804311 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-cc33ce25-8094-428f-adc4-fc7b3e0aaad7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:44.822653 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cc33ce25-8094-428f-adc4-fc7b3e0aaad7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:44.823488 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cc33ce25-8094-428f-adc4-fc7b3e0aaad7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:44.824974 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cc33ce25-8094-428f-adc4-fc7b3e0aaad7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:44.825834 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cc33ce25-8094-428f-adc4-fc7b3e0aaad7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:44.858593 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=100 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:45.269829 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-cc33ce25-8094-428f-adc4-fc7b3e0aaad7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:45.280016 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-cc33ce25-8094-428f-adc4-fc7b3e0aaad7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:45.284205 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-cc33ce25-8094-428f-adc4-fc7b3e0aaad7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:45.287015 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-cc33ce25-8094-428f-adc4-fc7b3e0aaad7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1808 microversion: 2.20 time: 0.490968 Aug 02 09:13:45.287015 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 184/362] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:44 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1808 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:45.291275 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-cecce233-45f6-4763-9fb8-2740efbc06ac tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:45.291960 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-cecce233-45f6-4763-9fb8-2740efbc06ac tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:45.302840 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cecce233-45f6-4763-9fb8-2740efbc06ac tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:45.303647 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cecce233-45f6-4763-9fb8-2740efbc06ac tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:45.305089 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cecce233-45f6-4763-9fb8-2740efbc06ac tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:45.305883 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cecce233-45f6-4763-9fb8-2740efbc06ac tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:45.475867 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-cecce233-45f6-4763-9fb8-2740efbc06ac tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:45.483893 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-cecce233-45f6-4763-9fb8-2740efbc06ac tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1259 microversion: 2.1 time: 0.196530 Aug 02 09:13:45.484518 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 185/363] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:45 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1259 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:45.593663 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-7c9ffe7f-677e-434d-8732-3afc9dd32fb1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "POST /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.190559 Aug 02 09:13:45.594273 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 179/364] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 2 09:13:39 2022] POST /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb/os-volume_attachments => generated 194 bytes in 6192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:46.320118 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-5c315611-052a-426c-8060-3c818727f718 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:46.320784 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-5c315611-052a-426c-8060-3c818727f718 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:46.326967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5c315611-052a-426c-8060-3c818727f718 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:46.327412 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5c315611-052a-426c-8060-3c818727f718 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:46.328767 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5c315611-052a-426c-8060-3c818727f718 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:46.329230 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5c315611-052a-426c-8060-3c818727f718 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:46.484076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-5c315611-052a-426c-8060-3c818727f718 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:46.493309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-5c315611-052a-426c-8060-3c818727f718 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:46.494825 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-5c315611-052a-426c-8060-3c818727f718 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:46.496014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-5c315611-052a-426c-8060-3c818727f718 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1808 microversion: 2.20 time: 0.180594 Aug 02 09:13:46.496617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 186/365] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:46 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:46.508904 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-9464241d-5073-4828-b96f-30a43d0d2e64 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:46.509981 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-9464241d-5073-4828-b96f-30a43d0d2e64 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:46.522196 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9464241d-5073-4828-b96f-30a43d0d2e64 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:46.527594 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9464241d-5073-4828-b96f-30a43d0d2e64 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:46.527594 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9464241d-5073-4828-b96f-30a43d0d2e64 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:46.527594 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9464241d-5073-4828-b96f-30a43d0d2e64 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:46.685253 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-9464241d-5073-4828-b96f-30a43d0d2e64 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:46.695000 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-9464241d-5073-4828-b96f-30a43d0d2e64 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1259 microversion: 2.1 time: 0.190707 Aug 02 09:13:46.696309 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 180/366] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:46 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1259 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:47.522020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-374c1991-1edc-4856-a332-7fce7c0b3941 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:47.522830 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-374c1991-1edc-4856-a332-7fce7c0b3941 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:47.529874 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-374c1991-1edc-4856-a332-7fce7c0b3941 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:47.530323 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-374c1991-1edc-4856-a332-7fce7c0b3941 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:47.531115 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-374c1991-1edc-4856-a332-7fce7c0b3941 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:47.531616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-374c1991-1edc-4856-a332-7fce7c0b3941 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:47.696786 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-374c1991-1edc-4856-a332-7fce7c0b3941 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:47.708447 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-374c1991-1edc-4856-a332-7fce7c0b3941 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:47.710002 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-374c1991-1edc-4856-a332-7fce7c0b3941 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:47.712212 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-374c1991-1edc-4856-a332-7fce7c0b3941 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1808 microversion: 2.20 time: 0.194018 Aug 02 09:13:47.712212 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 187/367] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:47 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:47.724416 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-7fac94d1-9352-481c-89f1-1bc154639c9f tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:47.724416 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-7fac94d1-9352-481c-89f1-1bc154639c9f tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:47.737045 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7fac94d1-9352-481c-89f1-1bc154639c9f tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:47.737972 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7fac94d1-9352-481c-89f1-1bc154639c9f tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:47.739022 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7fac94d1-9352-481c-89f1-1bc154639c9f tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:47.739881 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7fac94d1-9352-481c-89f1-1bc154639c9f tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:47.931574 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-7fac94d1-9352-481c-89f1-1bc154639c9f tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:47.945754 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-7fac94d1-9352-481c-89f1-1bc154639c9f tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1259 microversion: 2.1 time: 0.231212 Aug 02 09:13:47.947015 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 181/368] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:47 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1259 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:48.741709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-2a20563c-3964-4083-aa54-2b3560ff15be tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:48.742379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-2a20563c-3964-4083-aa54-2b3560ff15be tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:48.749869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2a20563c-3964-4083-aa54-2b3560ff15be tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:48.750276 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2a20563c-3964-4083-aa54-2b3560ff15be tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:48.751714 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2a20563c-3964-4083-aa54-2b3560ff15be tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:48.752494 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2a20563c-3964-4083-aa54-2b3560ff15be tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:48.916746 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-2a20563c-3964-4083-aa54-2b3560ff15be tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:48.927481 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-2a20563c-3964-4083-aa54-2b3560ff15be tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:48.929076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-2a20563c-3964-4083-aa54-2b3560ff15be tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:48.937146 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-2a20563c-3964-4083-aa54-2b3560ff15be tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1808 microversion: 2.20 time: 0.192497 Aug 02 09:13:48.937146 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 188/369] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:48 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:48.953838 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-7803f645-ac8d-4bbb-aa86-eb59d912c9b8 req-d8d17b86-3d26-4c24-a541-162d933089c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c36b6524-980c-4f56-b1ad-e71536c08577", "name": "network-vif-plugged", "status": "completed", "tag": "541f0637-de44-45f3-b1dd-7b7924d55993"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:48.967077 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-7803f645-ac8d-4bbb-aa86-eb59d912c9b8 req-d8d17b86-3d26-4c24-a541-162d933089c6 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:48.967514 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-7803f645-ac8d-4bbb-aa86-eb59d912c9b8 req-d8d17b86-3d26-4c24-a541-162d933089c6 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:48.981797 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-7803f645-ac8d-4bbb-aa86-eb59d912c9b8 req-d8d17b86-3d26-4c24-a541-162d933089c6 service nova] Creating event network-vif-plugged:541f0637-de44-45f3-b1dd-7b7924d55993 for instance c36b6524-980c-4f56-b1ad-e71536c08577 on hv-cinder-84599 Aug 02 09:13:48.983147 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-efb18baa-c3b0-4523-a071-b231effba1c1 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:48.983617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-efb18baa-c3b0-4523-a071-b231effba1c1 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:48.989490 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-7803f645-ac8d-4bbb-aa86-eb59d912c9b8 req-d8d17b86-3d26-4c24-a541-162d933089c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040050 Aug 02 09:13:48.990174 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 182/370] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:13:48.992001 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-efb18baa-c3b0-4523-a071-b231effba1c1 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:48.992718 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-efb18baa-c3b0-4523-a071-b231effba1c1 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:48.993430 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-efb18baa-c3b0-4523-a071-b231effba1c1 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:48.993872 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-efb18baa-c3b0-4523-a071-b231effba1c1 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:49.179558 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-efb18baa-c3b0-4523-a071-b231effba1c1 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:49.189533 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-efb18baa-c3b0-4523-a071-b231effba1c1 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1259 microversion: 2.1 time: 0.210273 Aug 02 09:13:49.190138 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 189/371] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:48 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1259 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:49.958441 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-f53380ab-a896-47b2-ba9e-3e419f1eb989 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:49.960178 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-f53380ab-a896-47b2-ba9e-3e419f1eb989 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:49.968665 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f53380ab-a896-47b2-ba9e-3e419f1eb989 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:49.969736 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f53380ab-a896-47b2-ba9e-3e419f1eb989 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:49.971331 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f53380ab-a896-47b2-ba9e-3e419f1eb989 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:49.971995 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f53380ab-a896-47b2-ba9e-3e419f1eb989 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:50.126919 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-f53380ab-a896-47b2-ba9e-3e419f1eb989 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:50.136401 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-f53380ab-a896-47b2-ba9e-3e419f1eb989 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:50.138571 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-f53380ab-a896-47b2-ba9e-3e419f1eb989 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:50.140150 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-f53380ab-a896-47b2-ba9e-3e419f1eb989 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1808 microversion: 2.20 time: 0.186386 Aug 02 09:13:50.141097 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 183/372] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:49 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:50.211928 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-21dbd431-2101-4ba4-82ac-3566802ece69 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:50.212603 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-21dbd431-2101-4ba4-82ac-3566802ece69 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:50.219366 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-21dbd431-2101-4ba4-82ac-3566802ece69 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:50.221478 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-21dbd431-2101-4ba4-82ac-3566802ece69 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:50.221478 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-21dbd431-2101-4ba4-82ac-3566802ece69 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:50.221478 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-21dbd431-2101-4ba4-82ac-3566802ece69 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:50.374187 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-21dbd431-2101-4ba4-82ac-3566802ece69 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:50.387120 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-21dbd431-2101-4ba4-82ac-3566802ece69 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1259 microversion: 2.1 time: 0.179238 Aug 02 09:13:50.390848 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 190/373] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:50 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:51.164504 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b9508aca-c6ce-4ba2-9c68-0446b1852c48 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:51.165121 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b9508aca-c6ce-4ba2-9c68-0446b1852c48 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:51.171692 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b9508aca-c6ce-4ba2-9c68-0446b1852c48 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:51.172146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b9508aca-c6ce-4ba2-9c68-0446b1852c48 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:51.173802 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b9508aca-c6ce-4ba2-9c68-0446b1852c48 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:51.174299 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b9508aca-c6ce-4ba2-9c68-0446b1852c48 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:51.356390 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b9508aca-c6ce-4ba2-9c68-0446b1852c48 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:51.366304 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b9508aca-c6ce-4ba2-9c68-0446b1852c48 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:51.367896 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b9508aca-c6ce-4ba2-9c68-0446b1852c48 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:51.369207 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b9508aca-c6ce-4ba2-9c68-0446b1852c48 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1808 microversion: 2.20 time: 0.208421 Aug 02 09:13:51.369703 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 184/374] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:51 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:13:51.419438 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-c50786c1-08ec-4c85-8d09-458fcbd48fb9 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:51.420221 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-c50786c1-08ec-4c85-8d09-458fcbd48fb9 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:51.427773 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c50786c1-08ec-4c85-8d09-458fcbd48fb9 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:51.428260 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c50786c1-08ec-4c85-8d09-458fcbd48fb9 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:51.429102 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c50786c1-08ec-4c85-8d09-458fcbd48fb9 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:51.429540 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c50786c1-08ec-4c85-8d09-458fcbd48fb9 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:51.609597 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-c50786c1-08ec-4c85-8d09-458fcbd48fb9 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:51.623991 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-c50786c1-08ec-4c85-8d09-458fcbd48fb9 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1259 microversion: 2.1 time: 0.211128 Aug 02 09:13:51.624981 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 191/375] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:51 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1259 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:13:52.394130 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-e470b178-84ee-4576-a424-825e9113a722 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:52.394750 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-e470b178-84ee-4576-a424-825e9113a722 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:52.401833 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e470b178-84ee-4576-a424-825e9113a722 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:52.402279 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e470b178-84ee-4576-a424-825e9113a722 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:52.403050 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e470b178-84ee-4576-a424-825e9113a722 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:52.403529 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e470b178-84ee-4576-a424-825e9113a722 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:52.547704 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-e470b178-84ee-4576-a424-825e9113a722 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:52.557122 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-e470b178-84ee-4576-a424-825e9113a722 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:52.558632 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-e470b178-84ee-4576-a424-825e9113a722 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:52.559781 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-e470b178-84ee-4576-a424-825e9113a722 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1808 microversion: 2.20 time: 0.170047 Aug 02 09:13:52.560337 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 185/376] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:52 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:52.653396 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ed14cd9f-eb8d-4b02-8d17-2b2601f1a0b5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:52.654109 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ed14cd9f-eb8d-4b02-8d17-2b2601f1a0b5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:52.661775 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ed14cd9f-eb8d-4b02-8d17-2b2601f1a0b5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:52.662221 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ed14cd9f-eb8d-4b02-8d17-2b2601f1a0b5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:52.662992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ed14cd9f-eb8d-4b02-8d17-2b2601f1a0b5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:52.663427 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ed14cd9f-eb8d-4b02-8d17-2b2601f1a0b5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:52.813434 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ed14cd9f-eb8d-4b02-8d17-2b2601f1a0b5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:52.821576 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ed14cd9f-eb8d-4b02-8d17-2b2601f1a0b5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1443 microversion: 2.1 time: 0.172166 Aug 02 09:13:52.822367 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 192/377] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:52 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1443 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:52.844294 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-cf4269d8-69de-47f4-8b59-de68f237dcc9 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:52.846023 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-cf4269d8-69de-47f4-8b59-de68f237dcc9 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:52.852580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cf4269d8-69de-47f4-8b59-de68f237dcc9 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:52.852580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cf4269d8-69de-47f4-8b59-de68f237dcc9 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:52.853388 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cf4269d8-69de-47f4-8b59-de68f237dcc9 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:52.853832 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cf4269d8-69de-47f4-8b59-de68f237dcc9 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:53.002321 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-cf4269d8-69de-47f4-8b59-de68f237dcc9 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:53.010129 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-cf4269d8-69de-47f4-8b59-de68f237dcc9 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1443 microversion: 2.1 time: 0.169767 Aug 02 09:13:53.010704 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 186/378] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:52 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1443 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:53.584861 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-82fd515a-4e87-42ca-9731-e8841fe504a4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:53.585687 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-82fd515a-4e87-42ca-9731-e8841fe504a4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:53.592683 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-82fd515a-4e87-42ca-9731-e8841fe504a4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:53.592886 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-82fd515a-4e87-42ca-9731-e8841fe504a4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:53.593895 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-82fd515a-4e87-42ca-9731-e8841fe504a4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:53.594501 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-82fd515a-4e87-42ca-9731-e8841fe504a4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:53.820347 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-82fd515a-4e87-42ca-9731-e8841fe504a4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:53.834682 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-82fd515a-4e87-42ca-9731-e8841fe504a4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:53.837775 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-82fd515a-4e87-42ca-9731-e8841fe504a4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:53.840101 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-82fd515a-4e87-42ca-9731-e8841fe504a4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1808 microversion: 2.20 time: 0.259002 Aug 02 09:13:53.841164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 193/379] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:53 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1808 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:54.282353 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-7ba4d9d3-dea3-4618-89e4-04e141dcc5f6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:54.289890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7ba4d9d3-dea3-4618-89e4-04e141dcc5f6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:54.290351 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7ba4d9d3-dea3-4618-89e4-04e141dcc5f6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:54.364094 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-7ba4d9d3-dea3-4618-89e4-04e141dcc5f6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Going to try to stop instance {{(pid=118526) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 09:13:54.509632 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:54.616051 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-7ba4d9d3-dea3-4618-89e4-04e141dcc5f6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "POST /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb/action" status: 202 len: 0 microversion: 2.1 time: 0.338585 Aug 02 09:13:54.616716 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 187/380] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 2 09:13:54 2022] POST /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:13:54.626691 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-e8d69185-d843-46cf-9e54-d25dfbcf3699 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:54.627438 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-e8d69185-d843-46cf-9e54-d25dfbcf3699 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:54.636599 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e8d69185-d843-46cf-9e54-d25dfbcf3699 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:54.637374 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e8d69185-d843-46cf-9e54-d25dfbcf3699 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:54.638935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e8d69185-d843-46cf-9e54-d25dfbcf3699 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:54.639731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e8d69185-d843-46cf-9e54-d25dfbcf3699 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:54.873148 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-5506d362-4c2b-43d1-b350-798b04704b29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:54.874820 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-5506d362-4c2b-43d1-b350-798b04704b29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:54.883939 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-e8d69185-d843-46cf-9e54-d25dfbcf3699 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:54.903285 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-e8d69185-d843-46cf-9e54-d25dfbcf3699 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1720 microversion: 2.1 time: 0.281055 Aug 02 09:13:54.905834 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5506d362-4c2b-43d1-b350-798b04704b29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:54.907239 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5506d362-4c2b-43d1-b350-798b04704b29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:54.912608 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5506d362-4c2b-43d1-b350-798b04704b29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:54.912986 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 194/381] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:54 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1720 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:54.913903 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5506d362-4c2b-43d1-b350-798b04704b29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:54.948771 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-38ed8549-e59f-46c3-a22a-88626af2b1cd req-01b61936-f59b-4c2e-b957-d45d7faee78b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cca7c83-368d-4c02-a00c-d12a84825c27", "name": "network-vif-plugged", "status": "completed", "tag": "8f442acd-437f-4082-97ec-7f28749a0a8b"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:54.963377 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-38ed8549-e59f-46c3-a22a-88626af2b1cd req-01b61936-f59b-4c2e-b957-d45d7faee78b service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:54.963830 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-38ed8549-e59f-46c3-a22a-88626af2b1cd req-01b61936-f59b-4c2e-b957-d45d7faee78b service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:54.978670 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-38ed8549-e59f-46c3-a22a-88626af2b1cd req-01b61936-f59b-4c2e-b957-d45d7faee78b service nova] Creating event network-vif-plugged:8f442acd-437f-4082-97ec-7f28749a0a8b for instance 6cca7c83-368d-4c02-a00c-d12a84825c27 on hv-cinder-84599 Aug 02 09:13:54.984826 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-38ed8549-e59f-46c3-a22a-88626af2b1cd req-01b61936-f59b-4c2e-b957-d45d7faee78b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039018 Aug 02 09:13:54.984826 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 195/382] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:13:55.072456 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-5506d362-4c2b-43d1-b350-798b04704b29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:55.083647 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-5506d362-4c2b-43d1-b350-798b04704b29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:55.085237 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-5506d362-4c2b-43d1-b350-798b04704b29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:55.086424 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-5506d362-4c2b-43d1-b350-798b04704b29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1808 microversion: 2.20 time: 0.219629 Aug 02 09:13:55.086994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 188/383] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:54 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1808 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:55.968730 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4a60785a-6f19-4879-bc96-78877292462a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:55.970141 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-4a60785a-6f19-4879-bc96-78877292462a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:55.974191 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-d8b0653b-fdac-4697-b654-0e80694cfe6a req-7828fadd-5945-4795-bf57-de14b213ff9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c36b6524-980c-4f56-b1ad-e71536c08577", "tag": "541f0637-de44-45f3-b1dd-7b7924d55993"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:13:55.981865 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4a60785a-6f19-4879-bc96-78877292462a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:55.982657 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4a60785a-6f19-4879-bc96-78877292462a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:55.984342 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4a60785a-6f19-4879-bc96-78877292462a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:55.984943 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4a60785a-6f19-4879-bc96-78877292462a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:55.996481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-d8b0653b-fdac-4697-b654-0e80694cfe6a req-7828fadd-5945-4795-bf57-de14b213ff9e service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:55.996953 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-d8b0653b-fdac-4697-b654-0e80694cfe6a req-7828fadd-5945-4795-bf57-de14b213ff9e service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:56.013256 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-d8b0653b-fdac-4697-b654-0e80694cfe6a req-7828fadd-5945-4795-bf57-de14b213ff9e service nova] Creating event network-changed:541f0637-de44-45f3-b1dd-7b7924d55993 for instance c36b6524-980c-4f56-b1ad-e71536c08577 on hv-cinder-84599 Aug 02 09:13:56.024182 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-d8b0653b-fdac-4697-b654-0e80694cfe6a req-7828fadd-5945-4795-bf57-de14b213ff9e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060272 Aug 02 09:13:56.026263 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 189/384] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:13:56.114889 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-57df655a-89ed-4f99-a2cc-99345712c3a6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:56.116318 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-57df655a-89ed-4f99-a2cc-99345712c3a6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:56.123464 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-57df655a-89ed-4f99-a2cc-99345712c3a6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:56.123991 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-57df655a-89ed-4f99-a2cc-99345712c3a6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:56.125019 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-57df655a-89ed-4f99-a2cc-99345712c3a6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:56.125608 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-57df655a-89ed-4f99-a2cc-99345712c3a6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:56.259177 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-4a60785a-6f19-4879-bc96-78877292462a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:56.271265 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-4a60785a-6f19-4879-bc96-78877292462a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1720 microversion: 2.1 time: 0.325581 Aug 02 09:13:56.272545 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 196/385] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:55 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1720 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:56.346389 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-57df655a-89ed-4f99-a2cc-99345712c3a6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:56.358096 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-57df655a-89ed-4f99-a2cc-99345712c3a6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:56.366451 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-57df655a-89ed-4f99-a2cc-99345712c3a6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:56.366451 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-57df655a-89ed-4f99-a2cc-99345712c3a6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1808 microversion: 2.20 time: 0.251918 Aug 02 09:13:56.366451 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 190/386] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:56 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1808 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:13:57.294865 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-65bfef88-13e2-4c96-9c37-010957d03af0 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:57.296276 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-65bfef88-13e2-4c96-9c37-010957d03af0 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:57.304088 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-65bfef88-13e2-4c96-9c37-010957d03af0 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:57.304633 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-65bfef88-13e2-4c96-9c37-010957d03af0 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:57.305428 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-65bfef88-13e2-4c96-9c37-010957d03af0 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:57.305867 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-65bfef88-13e2-4c96-9c37-010957d03af0 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:57.390365 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-e00b58af-7c72-4c77-b7ad-ff17e7663edd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:57.392451 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-e00b58af-7c72-4c77-b7ad-ff17e7663edd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:57.400937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e00b58af-7c72-4c77-b7ad-ff17e7663edd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:57.401850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e00b58af-7c72-4c77-b7ad-ff17e7663edd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:57.404793 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e00b58af-7c72-4c77-b7ad-ff17e7663edd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:57.405711 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e00b58af-7c72-4c77-b7ad-ff17e7663edd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:57.542436 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-65bfef88-13e2-4c96-9c37-010957d03af0 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:57.551960 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-65bfef88-13e2-4c96-9c37-010957d03af0 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1720 microversion: 2.1 time: 0.261265 Aug 02 09:13:57.552851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 197/387] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:57 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1720 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:57.603397 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-e00b58af-7c72-4c77-b7ad-ff17e7663edd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:57.615402 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-e00b58af-7c72-4c77-b7ad-ff17e7663edd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:57.617317 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-e00b58af-7c72-4c77-b7ad-ff17e7663edd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:57.623119 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-e00b58af-7c72-4c77-b7ad-ff17e7663edd tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1808 microversion: 2.20 time: 0.234848 Aug 02 09:13:57.623119 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 191/388] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:57 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:13:58.578904 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-397fe057-02c9-424f-8cac-4478c1dc78ca tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:58.579991 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-397fe057-02c9-424f-8cac-4478c1dc78ca tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:58.589417 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-397fe057-02c9-424f-8cac-4478c1dc78ca tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:58.589879 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-397fe057-02c9-424f-8cac-4478c1dc78ca tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:58.590859 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-397fe057-02c9-424f-8cac-4478c1dc78ca tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:58.591311 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-397fe057-02c9-424f-8cac-4478c1dc78ca tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:58.645829 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c6d52152-4874-44f1-aa4c-264eb6608b98 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:58.646421 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-c6d52152-4874-44f1-aa4c-264eb6608b98 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:58.649040 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=48 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:13:58.654162 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c6d52152-4874-44f1-aa4c-264eb6608b98 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:58.654606 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c6d52152-4874-44f1-aa4c-264eb6608b98 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:58.655590 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c6d52152-4874-44f1-aa4c-264eb6608b98 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:58.656015 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c6d52152-4874-44f1-aa4c-264eb6608b98 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:58.814659 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-397fe057-02c9-424f-8cac-4478c1dc78ca tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:58.825021 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-397fe057-02c9-424f-8cac-4478c1dc78ca tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1720 microversion: 2.1 time: 0.253471 Aug 02 09:13:58.825690 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 198/389] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:58 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1720 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:13:58.846792 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-c6d52152-4874-44f1-aa4c-264eb6608b98 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:58.855636 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-c6d52152-4874-44f1-aa4c-264eb6608b98 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:58.857170 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-c6d52152-4874-44f1-aa4c-264eb6608b98 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:13:58.858344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-c6d52152-4874-44f1-aa4c-264eb6608b98 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1808 microversion: 2.20 time: 0.217087 Aug 02 09:13:58.858906 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 192/390] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:58 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:13:59.847895 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-fced10c6-3301-4ed2-afcb-1a4c24163786 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:59.848489 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-fced10c6-3301-4ed2-afcb-1a4c24163786 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:59.855047 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fced10c6-3301-4ed2-afcb-1a4c24163786 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:59.855484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fced10c6-3301-4ed2-afcb-1a4c24163786 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:59.856283 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fced10c6-3301-4ed2-afcb-1a4c24163786 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:59.856718 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fced10c6-3301-4ed2-afcb-1a4c24163786 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:59.884407 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b5309af9-92d3-4fae-b25b-820b722b71d8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:13:59.885120 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b5309af9-92d3-4fae-b25b-820b722b71d8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:13:59.899507 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b5309af9-92d3-4fae-b25b-820b722b71d8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:59.900187 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b5309af9-92d3-4fae-b25b-820b722b71d8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:13:59.901254 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b5309af9-92d3-4fae-b25b-820b722b71d8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:13:59.901848 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b5309af9-92d3-4fae-b25b-820b722b71d8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:00.099779 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-fced10c6-3301-4ed2-afcb-1a4c24163786 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:00.108572 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-fced10c6-3301-4ed2-afcb-1a4c24163786 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1720 microversion: 2.1 time: 0.265135 Aug 02 09:14:00.109162 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 199/391] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:13:59 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1720 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:00.109387 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b5309af9-92d3-4fae-b25b-820b722b71d8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:00.130105 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b5309af9-92d3-4fae-b25b-820b722b71d8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:00.132244 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b5309af9-92d3-4fae-b25b-820b722b71d8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:00.133860 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b5309af9-92d3-4fae-b25b-820b722b71d8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1795 microversion: 2.20 time: 0.253879 Aug 02 09:14:00.134708 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 193/392] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:13:59 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1795 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:14:01.131348 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-20de2604-2954-431a-9efb-a870dcedafc1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:01.131998 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-20de2604-2954-431a-9efb-a870dcedafc1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:01.138672 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-20de2604-2954-431a-9efb-a870dcedafc1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:01.139780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-20de2604-2954-431a-9efb-a870dcedafc1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:01.140009 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-20de2604-2954-431a-9efb-a870dcedafc1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:01.140487 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-20de2604-2954-431a-9efb-a870dcedafc1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:01.297269 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-20de2604-2954-431a-9efb-a870dcedafc1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:01.306714 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-20de2604-2954-431a-9efb-a870dcedafc1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1720 microversion: 2.1 time: 0.179376 Aug 02 09:14:01.308249 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 200/393] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:01 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1720 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:02.329239 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-977eed79-45ce-43e5-af90-fc0b461a08cc tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:02.329877 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-977eed79-45ce-43e5-af90-fc0b461a08cc tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:02.336918 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-977eed79-45ce-43e5-af90-fc0b461a08cc tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:02.337307 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-977eed79-45ce-43e5-af90-fc0b461a08cc tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:02.338080 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-977eed79-45ce-43e5-af90-fc0b461a08cc tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:02.338524 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-977eed79-45ce-43e5-af90-fc0b461a08cc tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:02.478880 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-977eed79-45ce-43e5-af90-fc0b461a08cc tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:02.487092 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-977eed79-45ce-43e5-af90-fc0b461a08cc tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1720 microversion: 2.1 time: 0.161977 Aug 02 09:14:02.487672 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 194/394] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:02 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:03.511775 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-70db99ac-a535-4623-8cf1-22383bb6c629 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:03.512680 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-70db99ac-a535-4623-8cf1-22383bb6c629 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:03.520610 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-70db99ac-a535-4623-8cf1-22383bb6c629 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:03.521052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-70db99ac-a535-4623-8cf1-22383bb6c629 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:03.521991 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-70db99ac-a535-4623-8cf1-22383bb6c629 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:03.522768 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-70db99ac-a535-4623-8cf1-22383bb6c629 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:03.687113 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-70db99ac-a535-4623-8cf1-22383bb6c629 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:03.690472 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=100 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:03.697687 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-70db99ac-a535-4623-8cf1-22383bb6c629 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1720 microversion: 2.1 time: 0.189741 Aug 02 09:14:03.698263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 201/395] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:03 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1720 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:04.723809 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-237f3310-7f57-4f9b-972f-439499cfd3fd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:04.724939 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-237f3310-7f57-4f9b-972f-439499cfd3fd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:04.733476 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-237f3310-7f57-4f9b-972f-439499cfd3fd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:04.733962 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-237f3310-7f57-4f9b-972f-439499cfd3fd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:04.735385 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-237f3310-7f57-4f9b-972f-439499cfd3fd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:04.735712 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-237f3310-7f57-4f9b-972f-439499cfd3fd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:04.913246 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-237f3310-7f57-4f9b-972f-439499cfd3fd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:04.934176 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-237f3310-7f57-4f9b-972f-439499cfd3fd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1720 microversion: 2.1 time: 0.216159 Aug 02 09:14:04.934771 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 195/396] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:04 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1720 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:05.959112 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-13b6bf53-8006-4511-b358-a06848770b8c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:05.959865 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-13b6bf53-8006-4511-b358-a06848770b8c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:05.967799 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-13b6bf53-8006-4511-b358-a06848770b8c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:05.968282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-13b6bf53-8006-4511-b358-a06848770b8c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:05.969107 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-13b6bf53-8006-4511-b358-a06848770b8c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:05.970019 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-13b6bf53-8006-4511-b358-a06848770b8c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:06.128385 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-13b6bf53-8006-4511-b358-a06848770b8c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:06.137208 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-13b6bf53-8006-4511-b358-a06848770b8c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1720 microversion: 2.1 time: 0.184579 Aug 02 09:14:06.137795 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 202/397] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:05 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:07.162408 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-77934f5c-e5b3-4ed7-8283-5c844ed01dc7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:07.163071 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-77934f5c-e5b3-4ed7-8283-5c844ed01dc7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:07.170688 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-77934f5c-e5b3-4ed7-8283-5c844ed01dc7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:07.171144 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-77934f5c-e5b3-4ed7-8283-5c844ed01dc7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:07.171939 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-77934f5c-e5b3-4ed7-8283-5c844ed01dc7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:07.173093 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-77934f5c-e5b3-4ed7-8283-5c844ed01dc7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:07.340093 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-77934f5c-e5b3-4ed7-8283-5c844ed01dc7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:07.350094 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-77934f5c-e5b3-4ed7-8283-5c844ed01dc7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1720 microversion: 2.1 time: 0.191843 Aug 02 09:14:07.350806 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 196/398] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:07 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1720 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:08.372848 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-605745ee-0f84-449b-a7a5-08cfc2a02454 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:08.389021 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-605745ee-0f84-449b-a7a5-08cfc2a02454 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:08.389021 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-605745ee-0f84-449b-a7a5-08cfc2a02454 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:08.389021 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-605745ee-0f84-449b-a7a5-08cfc2a02454 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:08.389021 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-605745ee-0f84-449b-a7a5-08cfc2a02454 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:08.389784 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-605745ee-0f84-449b-a7a5-08cfc2a02454 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:08.551006 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-605745ee-0f84-449b-a7a5-08cfc2a02454 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:08.560321 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-605745ee-0f84-449b-a7a5-08cfc2a02454 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1720 microversion: 2.1 time: 0.191821 Aug 02 09:14:08.561024 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 203/399] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:08 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1720 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:09.583734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-4885e9ec-3902-42b6-b63d-2af5d13d82f6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:09.584947 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-4885e9ec-3902-42b6-b63d-2af5d13d82f6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:09.591842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4885e9ec-3902-42b6-b63d-2af5d13d82f6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:09.592392 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4885e9ec-3902-42b6-b63d-2af5d13d82f6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:09.593112 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4885e9ec-3902-42b6-b63d-2af5d13d82f6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:09.593552 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4885e9ec-3902-42b6-b63d-2af5d13d82f6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:09.735571 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-4885e9ec-3902-42b6-b63d-2af5d13d82f6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:09.743889 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-4885e9ec-3902-42b6-b63d-2af5d13d82f6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1720 microversion: 2.1 time: 0.164148 Aug 02 09:14:09.744497 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 197/400] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:09 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:10.767965 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-075d2351-bb90-45d5-8346-0afa7e2e06d0 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:10.768649 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-075d2351-bb90-45d5-8346-0afa7e2e06d0 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:10.776106 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-075d2351-bb90-45d5-8346-0afa7e2e06d0 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:10.776590 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-075d2351-bb90-45d5-8346-0afa7e2e06d0 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:10.777384 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-075d2351-bb90-45d5-8346-0afa7e2e06d0 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:10.777826 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-075d2351-bb90-45d5-8346-0afa7e2e06d0 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:10.943532 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-075d2351-bb90-45d5-8346-0afa7e2e06d0 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:10.954548 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-075d2351-bb90-45d5-8346-0afa7e2e06d0 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1720 microversion: 2.1 time: 0.191064 Aug 02 09:14:10.955155 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 204/401] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:10 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1720 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:11.978508 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-2b0082ce-c02a-4da3-8676-f060531f1359 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:11.979565 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-2b0082ce-c02a-4da3-8676-f060531f1359 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:11.987953 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2b0082ce-c02a-4da3-8676-f060531f1359 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:11.989612 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2b0082ce-c02a-4da3-8676-f060531f1359 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:11.989612 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2b0082ce-c02a-4da3-8676-f060531f1359 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:11.989887 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2b0082ce-c02a-4da3-8676-f060531f1359 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:12.152529 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-2b0082ce-c02a-4da3-8676-f060531f1359 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:12.162636 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-2b0082ce-c02a-4da3-8676-f060531f1359 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1720 microversion: 2.1 time: 0.189324 Aug 02 09:14:12.163354 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 198/402] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:11 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1720 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:13.185312 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4d83af41-ba6d-4cfd-9464-e4ab1a50c9e5 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:13.186126 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-4d83af41-ba6d-4cfd-9464-e4ab1a50c9e5 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:13.197082 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4d83af41-ba6d-4cfd-9464-e4ab1a50c9e5 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:13.198436 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4d83af41-ba6d-4cfd-9464-e4ab1a50c9e5 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:13.199789 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4d83af41-ba6d-4cfd-9464-e4ab1a50c9e5 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:13.200526 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4d83af41-ba6d-4cfd-9464-e4ab1a50c9e5 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:13.384398 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-4d83af41-ba6d-4cfd-9464-e4ab1a50c9e5 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:13.398486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-4d83af41-ba6d-4cfd-9464-e4ab1a50c9e5 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1697 microversion: 2.1 time: 0.217269 Aug 02 09:14:13.399942 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 205/403] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:13 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1697 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:13.421153 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-3b763d35-10f9-45f3-84df-ae410bce2f16 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:13.428734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3b763d35-10f9-45f3-84df-ae410bce2f16 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:13.429190 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3b763d35-10f9-45f3-84df-ae410bce2f16 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:13.462461 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-3b763d35-10f9-45f3-84df-ae410bce2f16 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Going to try to start instance {{(pid=118526) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 02 09:14:13.693527 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-3b763d35-10f9-45f3-84df-ae410bce2f16 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "POST /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb/action" status: 202 len: 0 microversion: 2.1 time: 0.276042 Aug 02 09:14:13.694026 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 199/404] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 2 09:14:13 2022] POST /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:14:13.704438 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ea51af40-c306-4a4a-8f2a-eba9de7c58aa tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:13.705089 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ea51af40-c306-4a4a-8f2a-eba9de7c58aa tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:13.711609 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ea51af40-c306-4a4a-8f2a-eba9de7c58aa tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:13.712059 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ea51af40-c306-4a4a-8f2a-eba9de7c58aa tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:13.712918 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ea51af40-c306-4a4a-8f2a-eba9de7c58aa tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:13.713354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ea51af40-c306-4a4a-8f2a-eba9de7c58aa tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:13.880117 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ea51af40-c306-4a4a-8f2a-eba9de7c58aa tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:13.889707 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ea51af40-c306-4a4a-8f2a-eba9de7c58aa tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1706 microversion: 2.1 time: 0.190203 Aug 02 09:14:13.890235 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 206/405] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:13 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1706 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:14.748910 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-f9b829ab-7c1e-475f-a134-64ec30e60f3f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:14.750125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-f9b829ab-7c1e-475f-a134-64ec30e60f3f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:14.756551 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f9b829ab-7c1e-475f-a134-64ec30e60f3f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:14.757148 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f9b829ab-7c1e-475f-a134-64ec30e60f3f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:14.758070 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f9b829ab-7c1e-475f-a134-64ec30e60f3f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:14.758487 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f9b829ab-7c1e-475f-a134-64ec30e60f3f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:14.786130 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-f9b829ab-7c1e-475f-a134-64ec30e60f3f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912/ips" status: 200 len: 151 microversion: 2.1 time: 0.044846 Aug 02 09:14:14.790215 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 200/406] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 2 09:14:14 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:14.801652 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-aadf9eb0-c6f3-4423-8c5e-a63b0931821e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af5baf2b-ec12-456c-8e83-19abd75a709b"}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:14.804415 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-aadf9eb0-c6f3-4423-8c5e-a63b0931821e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:14.806817 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=50 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:14.813714 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-aadf9eb0-c6f3-4423-8c5e-a63b0931821e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:14.814459 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-aadf9eb0-c6f3-4423-8c5e-a63b0931821e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:14.815298 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-aadf9eb0-c6f3-4423-8c5e-a63b0931821e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:14.815835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-aadf9eb0-c6f3-4423-8c5e-a63b0931821e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:14.916583 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-92b98b06-ae1f-4863-b657-0d9b109ba7b9 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:14.917631 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-92b98b06-ae1f-4863-b657-0d9b109ba7b9 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:14.921693 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-aadf9eb0-c6f3-4423-8c5e-a63b0931821e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] HTTP exception thrown: Invalid volume: volume af5baf2b-ec12-456c-8e83-19abd75a709b is already attached to instances: f9660960-566d-48c4-b5a7-413789e0e2c7 Aug 02 09:14:14.924282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-aadf9eb0-c6f3-4423-8c5e-a63b0931821e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Request method failure captured: Aug 02 09:14:14.924282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: POST /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912/os-volume_attachments HTTP/1.1 Aug 02 09:14:14.924282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:14:14.924282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:14:14.924282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:14:14.924282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 74 Aug 02 09:14:14.924282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:14:14.924282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:14:14.924282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:14:14.924282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:14:14.924282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6OoKOsXfjNTp1mjsj6r1IgBAgQBzTLiQjJO0bR1TldRTpxWx6tSFZWanW3Gv02s-EY-9kVRC92iBnbzPS2ztWMdgardIrvDP60IsZABewH2eMK4dXX1f7Hpv6gsaQwPQ8jW613IMovFbfYZIhNfO_yD-aTLWmHXV3Hwct_s6HofR820 Aug 02 09:14:14.924282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:14:14.924282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:14:14.924282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:14:14.924282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:14:14.924282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:14:14.924282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:14:14.924282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:14:14.924282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:14:14.924282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:14:14.924282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:14:14.926463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6fc6b07497a48eeb263b3a9b8aa7499"}]}] Aug 02 09:14:14.926463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:14:14.926463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:14:14.926463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:14:14.926463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:14:14.926463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:14:14.926463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:14:14.926463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: ad3a9141e9284bb5a096fb04d3e9d581 Aug 02 09:14:14.926463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:14:14.926463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Aug 02 09:14:14.926463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {"volumeAttachment": {"volumeId": "af5baf2b-ec12-456c-8e83-19abd75a709b"}} Aug 02 09:14:14.926463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: > Aug 02 09:14:14.927617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Invalid volume: volume af5baf2b-ec12-456c-8e83-19abd75a709b is already attached to instances: f9660960-566d-48c4-b5a7-413789e0e2c7 Aug 02 09:14:14.927617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'server_id': '0cc9a7eb-eb1a-4b92-a548-da35114c2912', 'body': {'volumeAttachment': {'volumeId': 'af5baf2b-ec12-456c-8e83-19abd75a709b'}}} Aug 02 09:14:14.927617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:14:14.927617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:14.927617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 09:14:14.927617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 09:14:14.927617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 09:14:14.927617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:14:14.927617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 09:14:14.927617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 09:14:14.927617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 02 09:14:14.927617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 02 09:14:14.927617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 02 09:14:14.927617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 02 09:14:14.927617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume af5baf2b-ec12-456c-8e83-19abd75a709b is already attached to instances: f9660960-566d-48c4-b5a7-413789e0e2c7 Aug 02 09:14:14.927617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:14:14.927617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:14.927617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:14:14.927617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:14.929020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:14.929020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:14.929020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:14:14.929020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:14:14.929020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:14:14.929020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:14:14.929020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:14:14.929020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:14:14.929020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:14:14.929020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:14:14.929020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:14:14.929020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:14:14.929020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 02 09:14:14.929020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 09:14:14.929020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume af5baf2b-ec12-456c-8e83-19abd75a709b is already attached to instances: f9660960-566d-48c4-b5a7-413789e0e2c7 Aug 02 09:14:14.929020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:14:14.929020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:14.929020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:14:14.929020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:14.929020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:14.930620 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:14.930620 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:14:14.930620 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:14:14.930620 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume af5baf2b-ec12-456c-8e83-19abd75a709b is already attached to instances: f9660960-566d-48c4-b5a7-413789e0e2c7 Aug 02 09:14:14.930620 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:14:14.930620 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-aadf9eb0-c6f3-4423-8c5e-a63b0931821e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Returning 400 to user: Invalid volume: volume af5baf2b-ec12-456c-8e83-19abd75a709b is already attached to instances: f9660960-566d-48c4-b5a7-413789e0e2c7 {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:14:14.931111 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-92b98b06-ae1f-4863-b657-0d9b109ba7b9 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:14.931209 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-aadf9eb0-c6f3-4423-8c5e-a63b0931821e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "POST /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.128489 Aug 02 09:14:14.931295 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-92b98b06-ae1f-4863-b657-0d9b109ba7b9 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:14.931383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 207/407] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 2 09:14:14 2022] POST /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912/os-volume_attachments => generated 174 bytes in 130 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 02 09:14:14.931463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-92b98b06-ae1f-4863-b657-0d9b109ba7b9 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:14.931463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-92b98b06-ae1f-4863-b657-0d9b109ba7b9 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:14.938692 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-92040c06-1b87-454e-ad10-0ac4410d7368 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:14.939580 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-92040c06-1b87-454e-ad10-0ac4410d7368 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:14.947777 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-92040c06-1b87-454e-ad10-0ac4410d7368 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:14.948245 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-92040c06-1b87-454e-ad10-0ac4410d7368 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:14.949035 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-92040c06-1b87-454e-ad10-0ac4410d7368 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:14.949466 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-92040c06-1b87-454e-ad10-0ac4410d7368 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:14.983553 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-92040c06-1b87-454e-ad10-0ac4410d7368 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Going to try to terminate instance {{(pid=118525) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:14:15.084104 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-92b98b06-ae1f-4863-b657-0d9b109ba7b9 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:15.093139 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-92b98b06-ae1f-4863-b657-0d9b109ba7b9 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1706 microversion: 2.1 time: 0.183419 Aug 02 09:14:15.095476 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 201/408] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:14 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1706 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:15.349490 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-92040c06-1b87-454e-ad10-0ac4410d7368 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 204 len: 0 microversion: 2.1 time: 0.417641 Aug 02 09:14:15.350066 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 208/409] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:14:14 2022] DELETE /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:14:15.360814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-adffb87e-b07b-4393-8cff-5a022195be35 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:15.362010 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-adffb87e-b07b-4393-8cff-5a022195be35 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:15.372354 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-adffb87e-b07b-4393-8cff-5a022195be35 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:15.373258 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-adffb87e-b07b-4393-8cff-5a022195be35 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:15.374603 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-adffb87e-b07b-4393-8cff-5a022195be35 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:15.375538 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-adffb87e-b07b-4393-8cff-5a022195be35 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:15.554287 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-adffb87e-b07b-4393-8cff-5a022195be35 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:15.562009 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-adffb87e-b07b-4393-8cff-5a022195be35 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1683 microversion: 2.1 time: 0.207394 Aug 02 09:14:15.562571 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 202/410] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:15 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1683 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:16.116520 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-eb7f09e3-234a-4e06-aeac-db3223c7d954 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:16.117230 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-eb7f09e3-234a-4e06-aeac-db3223c7d954 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:16.124734 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-eb7f09e3-234a-4e06-aeac-db3223c7d954 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:16.125188 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-eb7f09e3-234a-4e06-aeac-db3223c7d954 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:16.126206 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-eb7f09e3-234a-4e06-aeac-db3223c7d954 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:16.126632 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-eb7f09e3-234a-4e06-aeac-db3223c7d954 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:16.274035 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-eb7f09e3-234a-4e06-aeac-db3223c7d954 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:16.283982 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-eb7f09e3-234a-4e06-aeac-db3223c7d954 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1706 microversion: 2.1 time: 0.171652 Aug 02 09:14:16.284709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 209/411] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:16 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1706 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:16.588460 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-8a274f4f-adf7-485d-bf52-60f1b21ca3de tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:16.589740 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-8a274f4f-adf7-485d-bf52-60f1b21ca3de tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:16.602438 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-8a274f4f-adf7-485d-bf52-60f1b21ca3de tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:16.603262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-8a274f4f-adf7-485d-bf52-60f1b21ca3de tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:16.604687 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-8a274f4f-adf7-485d-bf52-60f1b21ca3de tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:16.605473 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-8a274f4f-adf7-485d-bf52-60f1b21ca3de tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:16.815155 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-8a274f4f-adf7-485d-bf52-60f1b21ca3de tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:16.824469 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-8a274f4f-adf7-485d-bf52-60f1b21ca3de tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1683 microversion: 2.1 time: 0.243149 Aug 02 09:14:16.825180 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 203/412] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:16 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1683 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:17.307495 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-c70ea259-5334-4d48-94ad-6efeb153da59 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:17.308217 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-c70ea259-5334-4d48-94ad-6efeb153da59 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:17.315841 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c70ea259-5334-4d48-94ad-6efeb153da59 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:17.316364 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c70ea259-5334-4d48-94ad-6efeb153da59 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:17.317110 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c70ea259-5334-4d48-94ad-6efeb153da59 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:17.317548 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c70ea259-5334-4d48-94ad-6efeb153da59 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:17.477827 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-c70ea259-5334-4d48-94ad-6efeb153da59 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:17.486789 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-c70ea259-5334-4d48-94ad-6efeb153da59 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1706 microversion: 2.1 time: 0.183316 Aug 02 09:14:17.487368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 210/413] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:17 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1706 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:17.852739 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-3620c1a3-b906-42e6-b1cf-9207acb4e36e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:17.853818 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-3620c1a3-b906-42e6-b1cf-9207acb4e36e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:17.863461 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3620c1a3-b906-42e6-b1cf-9207acb4e36e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:17.863990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3620c1a3-b906-42e6-b1cf-9207acb4e36e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:17.865170 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3620c1a3-b906-42e6-b1cf-9207acb4e36e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:17.865793 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3620c1a3-b906-42e6-b1cf-9207acb4e36e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:17.889341 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:18.035163 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-3620c1a3-b906-42e6-b1cf-9207acb4e36e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:18.043415 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-3620c1a3-b906-42e6-b1cf-9207acb4e36e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1683 microversion: 2.1 time: 0.197174 Aug 02 09:14:18.043993 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 204/414] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:17 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1683 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:18.509833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-5bdfc34a-1610-430a-a2e7-45c1b9371120 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:18.510507 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-5bdfc34a-1610-430a-a2e7-45c1b9371120 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:18.518785 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5bdfc34a-1610-430a-a2e7-45c1b9371120 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:18.523598 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5bdfc34a-1610-430a-a2e7-45c1b9371120 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:18.523598 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5bdfc34a-1610-430a-a2e7-45c1b9371120 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:18.523598 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5bdfc34a-1610-430a-a2e7-45c1b9371120 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:18.848341 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-5bdfc34a-1610-430a-a2e7-45c1b9371120 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:18.856771 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-5bdfc34a-1610-430a-a2e7-45c1b9371120 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1706 microversion: 2.1 time: 0.350993 Aug 02 09:14:18.857358 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 211/415] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:18 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1706 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:19.068272 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-40468698-a96c-4b1e-bc4c-f29c9b7f4272 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:19.068876 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-40468698-a96c-4b1e-bc4c-f29c9b7f4272 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:19.076696 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-40468698-a96c-4b1e-bc4c-f29c9b7f4272 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:19.077460 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-40468698-a96c-4b1e-bc4c-f29c9b7f4272 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:19.078188 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-40468698-a96c-4b1e-bc4c-f29c9b7f4272 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:19.079179 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-40468698-a96c-4b1e-bc4c-f29c9b7f4272 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:19.236669 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-40468698-a96c-4b1e-bc4c-f29c9b7f4272 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:19.244679 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-40468698-a96c-4b1e-bc4c-f29c9b7f4272 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1683 microversion: 2.1 time: 0.181373 Aug 02 09:14:19.245253 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 205/416] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:19 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1683 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:19.881430 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d0d802ee-1350-477d-be56-360173cf7e37 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:19.882055 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-d0d802ee-1350-477d-be56-360173cf7e37 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:19.889658 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d0d802ee-1350-477d-be56-360173cf7e37 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:19.890110 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d0d802ee-1350-477d-be56-360173cf7e37 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:19.891400 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d0d802ee-1350-477d-be56-360173cf7e37 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:19.892078 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d0d802ee-1350-477d-be56-360173cf7e37 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:20.043891 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d0d802ee-1350-477d-be56-360173cf7e37 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:20.053085 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-d0d802ee-1350-477d-be56-360173cf7e37 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1706 microversion: 2.1 time: 0.175917 Aug 02 09:14:20.053684 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 212/417] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:19 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1706 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:20.268830 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-30c3b8c4-37dd-4359-b283-de0881c92f1f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:20.269461 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-30c3b8c4-37dd-4359-b283-de0881c92f1f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:20.276729 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-30c3b8c4-37dd-4359-b283-de0881c92f1f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:20.277180 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-30c3b8c4-37dd-4359-b283-de0881c92f1f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:20.277986 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-30c3b8c4-37dd-4359-b283-de0881c92f1f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:20.278423 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-30c3b8c4-37dd-4359-b283-de0881c92f1f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:20.439288 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-30c3b8c4-37dd-4359-b283-de0881c92f1f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:20.451558 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-30c3b8c4-37dd-4359-b283-de0881c92f1f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1683 microversion: 2.1 time: 0.187606 Aug 02 09:14:20.452623 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 206/418] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:20 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1683 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:21.079943 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ff53459f-288c-47ec-b36e-56d50fd62eaa tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:21.081161 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ff53459f-288c-47ec-b36e-56d50fd62eaa tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:21.090540 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ff53459f-288c-47ec-b36e-56d50fd62eaa tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:21.091000 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ff53459f-288c-47ec-b36e-56d50fd62eaa tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:21.091798 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ff53459f-288c-47ec-b36e-56d50fd62eaa tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:21.092268 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ff53459f-288c-47ec-b36e-56d50fd62eaa tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:21.233161 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ff53459f-288c-47ec-b36e-56d50fd62eaa tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:21.246858 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ff53459f-288c-47ec-b36e-56d50fd62eaa tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1706 microversion: 2.1 time: 0.174767 Aug 02 09:14:21.247444 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 213/419] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:21 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1706 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:21.476091 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-407615b1-af9e-4c39-8920-a3b902a4d314 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:21.476862 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-407615b1-af9e-4c39-8920-a3b902a4d314 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:21.483896 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-407615b1-af9e-4c39-8920-a3b902a4d314 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:21.484378 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-407615b1-af9e-4c39-8920-a3b902a4d314 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:21.485443 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-407615b1-af9e-4c39-8920-a3b902a4d314 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:21.486126 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-407615b1-af9e-4c39-8920-a3b902a4d314 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:21.636779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-407615b1-af9e-4c39-8920-a3b902a4d314 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:21.645237 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-407615b1-af9e-4c39-8920-a3b902a4d314 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1683 microversion: 2.1 time: 0.173100 Aug 02 09:14:21.645802 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 207/420] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:21 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:22.270773 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-fbe9d1e2-2a89-4ecd-b043-a39612fd7e6a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:22.280263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-fbe9d1e2-2a89-4ecd-b043-a39612fd7e6a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:22.293878 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fbe9d1e2-2a89-4ecd-b043-a39612fd7e6a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:22.294797 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fbe9d1e2-2a89-4ecd-b043-a39612fd7e6a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:22.296127 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fbe9d1e2-2a89-4ecd-b043-a39612fd7e6a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:22.296953 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fbe9d1e2-2a89-4ecd-b043-a39612fd7e6a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:22.491925 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-fbe9d1e2-2a89-4ecd-b043-a39612fd7e6a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:22.502026 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-fbe9d1e2-2a89-4ecd-b043-a39612fd7e6a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1706 microversion: 2.1 time: 0.236288 Aug 02 09:14:22.503344 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 214/421] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:22 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1706 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:22.667842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-fd3f8d9b-514a-487b-a4ba-2ff55219f258 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:22.668508 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-fd3f8d9b-514a-487b-a4ba-2ff55219f258 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:22.677692 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fd3f8d9b-514a-487b-a4ba-2ff55219f258 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:22.681283 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fd3f8d9b-514a-487b-a4ba-2ff55219f258 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:22.681283 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fd3f8d9b-514a-487b-a4ba-2ff55219f258 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:22.681283 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fd3f8d9b-514a-487b-a4ba-2ff55219f258 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:22.893985 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-fd3f8d9b-514a-487b-a4ba-2ff55219f258 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:22.907170 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-fd3f8d9b-514a-487b-a4ba-2ff55219f258 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1683 microversion: 2.1 time: 0.243036 Aug 02 09:14:22.907953 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 208/422] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:22 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1683 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:23.190232 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-aa97a24b-452e-4f2f-903f-83b302843e8c req-84849952-3230-4388-bf7d-45332842a7ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc9a7eb-eb1a-4b92-a548-da35114c2912", "name": "network-vif-deleted", "tag": "6d274d23-5313-4f79-b83a-3fd7fc8e216c"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:23.201180 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-aa97a24b-452e-4f2f-903f-83b302843e8c req-84849952-3230-4388-bf7d-45332842a7ae service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:23.201530 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-aa97a24b-452e-4f2f-903f-83b302843e8c req-84849952-3230-4388-bf7d-45332842a7ae service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:23.214461 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-aa97a24b-452e-4f2f-903f-83b302843e8c req-84849952-3230-4388-bf7d-45332842a7ae service nova] Creating event network-vif-deleted:6d274d23-5313-4f79-b83a-3fd7fc8e216c for instance 0cc9a7eb-eb1a-4b92-a548-da35114c2912 on hv-cinder-84599 Aug 02 09:14:23.221453 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-aa97a24b-452e-4f2f-903f-83b302843e8c req-84849952-3230-4388-bf7d-45332842a7ae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035394 Aug 02 09:14:23.225341 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 215/423] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:14:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:14:23.535496 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-185c283e-3b35-4b4f-b239-6b447520406c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:23.536353 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-185c283e-3b35-4b4f-b239-6b447520406c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:23.543737 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-185c283e-3b35-4b4f-b239-6b447520406c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:23.545049 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-185c283e-3b35-4b4f-b239-6b447520406c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:23.546280 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-185c283e-3b35-4b4f-b239-6b447520406c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:23.546998 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-185c283e-3b35-4b4f-b239-6b447520406c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:23.715337 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-185c283e-3b35-4b4f-b239-6b447520406c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:23.724823 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-185c283e-3b35-4b4f-b239-6b447520406c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1706 microversion: 2.1 time: 0.193748 Aug 02 09:14:23.725815 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 209/424] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:23 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1706 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:23.942316 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-3d62bb81-b745-4499-9932-50d87e5ecc98 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:23.943151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-3d62bb81-b745-4499-9932-50d87e5ecc98 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:23.959490 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3d62bb81-b745-4499-9932-50d87e5ecc98 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:23.959945 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3d62bb81-b745-4499-9932-50d87e5ecc98 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:23.960914 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3d62bb81-b745-4499-9932-50d87e5ecc98 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:23.961354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3d62bb81-b745-4499-9932-50d87e5ecc98 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:24.043633 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-3d62bb81-b745-4499-9932-50d87e5ecc98 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:24.055863 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-3d62bb81-b745-4499-9932-50d87e5ecc98 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1326 microversion: 2.1 time: 0.119365 Aug 02 09:14:24.057881 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 216/425] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:23 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1326 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:24.095993 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b9972683-92b9-4b95-a5ae-b58fa60feb17 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83808ea6-072c-432e-8823-374952b9e43d"}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:24.105345 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b9972683-92b9-4b95-a5ae-b58fa60feb17 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:24.115682 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b9972683-92b9-4b95-a5ae-b58fa60feb17 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:24.116369 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b9972683-92b9-4b95-a5ae-b58fa60feb17 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:24.118344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b9972683-92b9-4b95-a5ae-b58fa60feb17 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:24.118867 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b9972683-92b9-4b95-a5ae-b58fa60feb17 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:24.760585 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-9564e815-af7f-4349-93f2-f39cb3842ea6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:24.763536 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-9564e815-af7f-4349-93f2-f39cb3842ea6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:24.781254 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9564e815-af7f-4349-93f2-f39cb3842ea6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:24.786484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9564e815-af7f-4349-93f2-f39cb3842ea6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:24.786484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9564e815-af7f-4349-93f2-f39cb3842ea6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:24.786484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9564e815-af7f-4349-93f2-f39cb3842ea6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:24.802514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:24.968621 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-9564e815-af7f-4349-93f2-f39cb3842ea6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:24.979655 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-9564e815-af7f-4349-93f2-f39cb3842ea6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1710 microversion: 2.1 time: 0.232233 Aug 02 09:14:24.980544 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 217/426] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:24 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1710 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:25.082604 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-257169c9-8e65-447b-a5f9-0eb34ef020cb tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:25.083307 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-257169c9-8e65-447b-a5f9-0eb34ef020cb tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:25.090645 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-257169c9-8e65-447b-a5f9-0eb34ef020cb tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:25.092107 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-257169c9-8e65-447b-a5f9-0eb34ef020cb tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:25.092370 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-257169c9-8e65-447b-a5f9-0eb34ef020cb tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:25.092822 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-257169c9-8e65-447b-a5f9-0eb34ef020cb tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:25.145860 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-257169c9-8e65-447b-a5f9-0eb34ef020cb tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:25.146394 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-257169c9-8e65-447b-a5f9-0eb34ef020cb tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:25.147121 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.objects.instance [None req-257169c9-8e65-447b-a5f9-0eb34ef020cb tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lazy-loading 'fault' on Instance uuid 0cc9a7eb-eb1a-4b92-a548-da35114c2912 {{(pid=118525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:14:25.212272 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-257169c9-8e65-447b-a5f9-0eb34ef020cb tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:25.225599 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-257169c9-8e65-447b-a5f9-0eb34ef020cb tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 200 len: 1331 microversion: 2.1 time: 0.146987 Aug 02 09:14:25.226794 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 218/427] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:25 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 1331 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:25.571400 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b9972683-92b9-4b95-a5ae-b58fa60feb17 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "POST /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.484534 Aug 02 09:14:25.572088 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 210/428] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 2 09:14:24 2022] POST /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d/os-volume_attachments => generated 194 bytes in 1487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:26.261742 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-0084faf6-d311-484f-99c0-cf18e1a39d9f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:26.262500 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-0084faf6-d311-484f-99c0-cf18e1a39d9f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:26.270076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0084faf6-d311-484f-99c0-cf18e1a39d9f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:26.270596 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0084faf6-d311-484f-99c0-cf18e1a39d9f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:26.271383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0084faf6-d311-484f-99c0-cf18e1a39d9f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:26.271812 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0084faf6-d311-484f-99c0-cf18e1a39d9f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:26.288480 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-0084faf6-d311-484f-99c0-cf18e1a39d9f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] HTTP exception thrown: Instance 0cc9a7eb-eb1a-4b92-a548-da35114c2912 could not be found. Aug 02 09:14:26.290263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-0084faf6-d311-484f-99c0-cf18e1a39d9f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Request method failure captured: Aug 02 09:14:26.290263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 HTTP/1.1 Aug 02 09:14:26.290263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:14:26.290263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:14:26.290263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:14:26.290263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:14:26.290263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:14:26.290263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:14:26.290263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:14:26.290263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:14:26.290263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6OoKOsXfjNTp1mjsj6r1IgBAgQBzTLiQjJO0bR1TldRTpxWx6tSFZWanW3Gv02s-EY-9kVRC92iBnbzPS2ztWMdgardIrvDP60IsZABewH2eMK4dXX1f7Hpv6gsaQwPQ8jW613IMovFbfYZIhNfO_yD-aTLWmHXV3Hwct_s6HofR820 Aug 02 09:14:26.290263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:14:26.290263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:14:26.290263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:14:26.290263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:14:26.290263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:14:26.290263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:14:26.290263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:14:26.290263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:14:26.290263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:14:26.290263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:14:26.291581 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6fc6b07497a48eeb263b3a9b8aa7499"}]}] Aug 02 09:14:26.291581 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:14:26.291581 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:14:26.291581 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:14:26.291581 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:14:26.291581 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:14:26.291581 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:14:26.291581 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: ad3a9141e9284bb5a096fb04d3e9d581 Aug 02 09:14:26.291581 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:14:26.291581 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: > Aug 02 09:14:26.291581 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Instance 0cc9a7eb-eb1a-4b92-a548-da35114c2912 could not be found. Aug 02 09:14:26.291581 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': '0cc9a7eb-eb1a-4b92-a548-da35114c2912'} Aug 02 09:14:26.292301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:14:26.292301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:26.292301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:14:26.292301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:14:26.292301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:14:26.292301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:14:26.292301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:14:26.292301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:14:26.292301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:14:26.292301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:14:26.292301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cc9a7eb-eb1a-4b92-a548-da35114c2912 could not be found. Aug 02 09:14:26.292301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:14:26.292301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:26.292301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:14:26.292301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:26.292301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:26.292301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:26.292301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:14:26.292301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:14:26.292301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:14:26.293722 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:14:26.293722 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:14:26.293722 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:14:26.293722 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:14:26.293722 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:14:26.293722 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:14:26.293722 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:14:26.293722 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cc9a7eb-eb1a-4b92-a548-da35114c2912 could not be found. Aug 02 09:14:26.293722 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:14:26.293722 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:26.293722 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:14:26.293722 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:26.293722 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:26.293722 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:26.293722 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:14:26.293722 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:14:26.293722 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cc9a7eb-eb1a-4b92-a548-da35114c2912 could not be found. Aug 02 09:14:26.293722 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:14:26.294746 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-0084faf6-d311-484f-99c0-cf18e1a39d9f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Returning 404 to user: Instance 0cc9a7eb-eb1a-4b92-a548-da35114c2912 could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:14:26.294746 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-0084faf6-d311-484f-99c0-cf18e1a39d9f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 404 len: 111 microversion: 2.1 time: 0.034391 Aug 02 09:14:26.294746 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 219/429] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:26 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:14:26.301822 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-f40e02bc-4937-45f5-81fe-6b548ba73110 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '.version_select at 0x7ffb9ac13c10>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:26.431103 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-f40e02bc-4937-45f5-81fe-6b548ba73110 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1312668077" status: 202 len: 0 microversion: 2.1 time: 0.133759 Aug 02 09:14:26.431623 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 211/430] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Aug 2 09:14:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1312668077 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 09:14:27.447002 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-531539bc-1488-4bf1-9910-d602b8f75cf7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:27.447684 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-531539bc-1488-4bf1-9910-d602b8f75cf7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:27.456226 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-531539bc-1488-4bf1-9910-d602b8f75cf7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:27.456683 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-531539bc-1488-4bf1-9910-d602b8f75cf7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:27.457643 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-531539bc-1488-4bf1-9910-d602b8f75cf7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:27.458124 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-531539bc-1488-4bf1-9910-d602b8f75cf7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:27.605021 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.objects.instance [None req-531539bc-1488-4bf1-9910-d602b8f75cf7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lazy-loading 'services' on Instance uuid f9660960-566d-48c4-b5a7-413789e0e2c7 {{(pid=118525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:14:27.908890 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-531539bc-1488-4bf1-9910-d602b8f75cf7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7/os-volume_attachments/af5baf2b-ec12-456c-8e83-19abd75a709b" status: 202 len: 0 microversion: 2.1 time: 0.465845 Aug 02 09:14:27.909679 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 220/431] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 2 09:14:27 2022] DELETE /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7/os-volume_attachments/af5baf2b-ec12-456c-8e83-19abd75a709b => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 09:14:27.919077 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-12150ca0-da22-41bd-8950-534210512ed7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:27.922996 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-12150ca0-da22-41bd-8950-534210512ed7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:27.930798 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-12150ca0-da22-41bd-8950-534210512ed7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:27.931249 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-12150ca0-da22-41bd-8950-534210512ed7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:27.932217 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-12150ca0-da22-41bd-8950-534210512ed7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:27.932857 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-12150ca0-da22-41bd-8950-534210512ed7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:27.968646 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-12150ca0-da22-41bd-8950-534210512ed7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054027 Aug 02 09:14:27.969531 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 212/432] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:14:27 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:28.985503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-99561590-ea59-4a62-bb91-80e736169dee tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:28.988919 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-99561590-ea59-4a62-bb91-80e736169dee tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:28.996510 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-99561590-ea59-4a62-bb91-80e736169dee tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:28.996948 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-99561590-ea59-4a62-bb91-80e736169dee tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:28.997801 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-99561590-ea59-4a62-bb91-80e736169dee tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:28.998233 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-99561590-ea59-4a62-bb91-80e736169dee tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:29.037856 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-99561590-ea59-4a62-bb91-80e736169dee tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059230 Aug 02 09:14:29.038515 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 221/433] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:14:28 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:30.051738 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-31db8732-16a0-466f-ad20-1b277e6c19ff tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:30.054810 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-31db8732-16a0-466f-ad20-1b277e6c19ff tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:30.060446 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:30.065860 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-31db8732-16a0-466f-ad20-1b277e6c19ff tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:30.066306 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-31db8732-16a0-466f-ad20-1b277e6c19ff tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:30.067118 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-31db8732-16a0-466f-ad20-1b277e6c19ff tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:30.067551 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-31db8732-16a0-466f-ad20-1b277e6c19ff tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:30.108943 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-31db8732-16a0-466f-ad20-1b277e6c19ff tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063036 Aug 02 09:14:30.110180 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 213/434] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:14:30 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:31.124789 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-7dcb716b-4a70-40d2-8496-0b0c2a2c86a9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:31.127538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-7dcb716b-4a70-40d2-8496-0b0c2a2c86a9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:31.135007 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7dcb716b-4a70-40d2-8496-0b0c2a2c86a9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:31.135696 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7dcb716b-4a70-40d2-8496-0b0c2a2c86a9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:31.136654 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7dcb716b-4a70-40d2-8496-0b0c2a2c86a9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:31.138206 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7dcb716b-4a70-40d2-8496-0b0c2a2c86a9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:31.175317 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-7dcb716b-4a70-40d2-8496-0b0c2a2c86a9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055343 Aug 02 09:14:31.175907 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 222/435] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:14:31 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:14:32.189391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-4a55199a-b0fc-4c29-a4f7-27f3e20d6a0b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:32.191459 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-4a55199a-b0fc-4c29-a4f7-27f3e20d6a0b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:32.199850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4a55199a-b0fc-4c29-a4f7-27f3e20d6a0b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:32.200330 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4a55199a-b0fc-4c29-a4f7-27f3e20d6a0b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:32.202178 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4a55199a-b0fc-4c29-a4f7-27f3e20d6a0b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:32.202178 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4a55199a-b0fc-4c29-a4f7-27f3e20d6a0b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:32.245194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-4a55199a-b0fc-4c29-a4f7-27f3e20d6a0b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061092 Aug 02 09:14:32.246333 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 214/436] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:14:32 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:33.264668 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-8e48cbe5-ca0d-4a2b-b1ba-36f5b4572d41 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:33.268719 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-8e48cbe5-ca0d-4a2b-b1ba-36f5b4572d41 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:33.283059 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8e48cbe5-ca0d-4a2b-b1ba-36f5b4572d41 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:33.283774 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8e48cbe5-ca0d-4a2b-b1ba-36f5b4572d41 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:33.286357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8e48cbe5-ca0d-4a2b-b1ba-36f5b4572d41 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:33.290936 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8e48cbe5-ca0d-4a2b-b1ba-36f5b4572d41 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:33.328829 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-8e48cbe5-ca0d-4a2b-b1ba-36f5b4572d41 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071126 Aug 02 09:14:33.330192 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 223/437] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:14:33 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:34.312400 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-6e07d14c-9d3a-4e26-9c18-236ae2499f5b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:34.315783 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-6e07d14c-9d3a-4e26-9c18-236ae2499f5b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:34.324403 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6e07d14c-9d3a-4e26-9c18-236ae2499f5b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:34.324763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6e07d14c-9d3a-4e26-9c18-236ae2499f5b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:34.325630 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6e07d14c-9d3a-4e26-9c18-236ae2499f5b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:34.326300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6e07d14c-9d3a-4e26-9c18-236ae2499f5b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:34.342482 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-04be5112-9ed8-4f96-a4ed-ca6e83c4ccb2 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:34.347503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-04be5112-9ed8-4f96-a4ed-ca6e83c4ccb2 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:34.356136 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.objects.instance [None req-6e07d14c-9d3a-4e26-9c18-236ae2499f5b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lazy-loading 'flavor' on Instance uuid 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d {{(pid=118526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:14:34.356467 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-04be5112-9ed8-4f96-a4ed-ca6e83c4ccb2 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:34.356922 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-04be5112-9ed8-4f96-a4ed-ca6e83c4ccb2 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:34.357649 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-04be5112-9ed8-4f96-a4ed-ca6e83c4ccb2 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:34.358080 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-04be5112-9ed8-4f96-a4ed-ca6e83c4ccb2 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:34.416311 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-04be5112-9ed8-4f96-a4ed-ca6e83c4ccb2 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077778 Aug 02 09:14:34.416543 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 224/438] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:14:34 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:14:34.776750 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-6e07d14c-9d3a-4e26-9c18-236ae2499f5b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "POST /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d/action" status: 200 len: 32 microversion: 2.1 time: 0.469258 Aug 02 09:14:34.777770 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 215/439] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 2 09:14:34 2022] POST /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d/action => generated 32 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 09:14:34.787268 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-8a0a3939-ebfa-46ca-8295-a7a9b7400e5e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:34.788524 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-8a0a3939-ebfa-46ca-8295-a7a9b7400e5e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:34.807943 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8a0a3939-ebfa-46ca-8295-a7a9b7400e5e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:34.810361 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8a0a3939-ebfa-46ca-8295-a7a9b7400e5e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:34.811600 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8a0a3939-ebfa-46ca-8295-a7a9b7400e5e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:34.813445 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8a0a3939-ebfa-46ca-8295-a7a9b7400e5e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:34.992654 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-8a0a3939-ebfa-46ca-8295-a7a9b7400e5e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:35.003079 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-8a0a3939-ebfa-46ca-8295-a7a9b7400e5e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1735 microversion: 2.1 time: 0.219593 Aug 02 09:14:35.004592 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 225/440] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:34 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:35.435897 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-786bc126-4b11-4a67-984e-d5e8a0d62bce tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:35.440482 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-786bc126-4b11-4a67-984e-d5e8a0d62bce tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:35.458851 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-786bc126-4b11-4a67-984e-d5e8a0d62bce tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:35.459355 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-786bc126-4b11-4a67-984e-d5e8a0d62bce tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:35.460570 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-786bc126-4b11-4a67-984e-d5e8a0d62bce tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:35.460793 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-786bc126-4b11-4a67-984e-d5e8a0d62bce tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:35.496546 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-786bc126-4b11-4a67-984e-d5e8a0d62bce tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069325 Aug 02 09:14:35.503286 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 216/441] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:14:35 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7/os-volume_attachments => generated 25 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:14:35.582445 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-789782b0-57c5-47b2-9426-c11f4efd819b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:35.583011 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-789782b0-57c5-47b2-9426-c11f4efd819b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:35.589919 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-789782b0-57c5-47b2-9426-c11f4efd819b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:35.590370 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-789782b0-57c5-47b2-9426-c11f4efd819b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:35.591144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-789782b0-57c5-47b2-9426-c11f4efd819b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:35.592249 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-789782b0-57c5-47b2-9426-c11f4efd819b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:35.624026 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-789782b0-57c5-47b2-9426-c11f4efd819b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Going to try to terminate instance {{(pid=118525) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:14:36.037381 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-7342a0ba-213e-4905-91b3-27b892f6d66a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:36.038301 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-7342a0ba-213e-4905-91b3-27b892f6d66a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:36.044855 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7342a0ba-213e-4905-91b3-27b892f6d66a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:36.070397 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7342a0ba-213e-4905-91b3-27b892f6d66a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:36.070397 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7342a0ba-213e-4905-91b3-27b892f6d66a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:36.070397 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7342a0ba-213e-4905-91b3-27b892f6d66a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:36.118671 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-789782b0-57c5-47b2-9426-c11f4efd819b tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 204 len: 0 microversion: 2.1 time: 0.540399 Aug 02 09:14:36.120394 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 226/442] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:14:35 2022] DELETE /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:14:36.137518 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-9d43aa31-ae59-4ff3-9063-fc2fcd87a86f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:36.138403 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-9d43aa31-ae59-4ff3-9063-fc2fcd87a86f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:36.146199 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9d43aa31-ae59-4ff3-9063-fc2fcd87a86f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:36.146738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9d43aa31-ae59-4ff3-9063-fc2fcd87a86f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:36.147579 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9d43aa31-ae59-4ff3-9063-fc2fcd87a86f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:36.148255 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9d43aa31-ae59-4ff3-9063-fc2fcd87a86f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:36.218859 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-7342a0ba-213e-4905-91b3-27b892f6d66a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:36.224424 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-7342a0ba-213e-4905-91b3-27b892f6d66a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1735 microversion: 2.1 time: 0.192850 Aug 02 09:14:36.239313 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 217/443] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:36 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:36.349578 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-9d43aa31-ae59-4ff3-9063-fc2fcd87a86f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:36.358643 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-9d43aa31-ae59-4ff3-9063-fc2fcd87a86f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1681 microversion: 2.1 time: 0.227702 Aug 02 09:14:36.372884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 227/444] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:36 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1681 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:37.247571 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-e5128c02-f235-4533-8131-904c168c2fe0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:37.248399 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-e5128c02-f235-4533-8131-904c168c2fe0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:37.257771 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e5128c02-f235-4533-8131-904c168c2fe0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:37.258377 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e5128c02-f235-4533-8131-904c168c2fe0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:37.259286 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e5128c02-f235-4533-8131-904c168c2fe0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:37.259973 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e5128c02-f235-4533-8131-904c168c2fe0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:37.382928 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-f3ea3246-7de9-4bf8-8a88-ff93f52c673f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:37.383535 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-f3ea3246-7de9-4bf8-8a88-ff93f52c673f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:37.392613 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f3ea3246-7de9-4bf8-8a88-ff93f52c673f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:37.393473 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f3ea3246-7de9-4bf8-8a88-ff93f52c673f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:37.394570 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f3ea3246-7de9-4bf8-8a88-ff93f52c673f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:37.395269 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f3ea3246-7de9-4bf8-8a88-ff93f52c673f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:37.419979 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-e5128c02-f235-4533-8131-904c168c2fe0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:37.423260 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:37.430608 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-e5128c02-f235-4533-8131-904c168c2fe0 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1735 microversion: 2.1 time: 0.187403 Aug 02 09:14:37.448394 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 218/445] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:37 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:37.551036 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-f3ea3246-7de9-4bf8-8a88-ff93f52c673f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:37.563641 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-f3ea3246-7de9-4bf8-8a88-ff93f52c673f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1681 microversion: 2.1 time: 0.180547 Aug 02 09:14:37.563641 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 228/446] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:37 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:38.453615 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-056f3d7f-bb5c-4ed4-bc6f-bace1ba50a14 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:38.454281 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-056f3d7f-bb5c-4ed4-bc6f-bace1ba50a14 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:38.463918 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-056f3d7f-bb5c-4ed4-bc6f-bace1ba50a14 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:38.464407 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-056f3d7f-bb5c-4ed4-bc6f-bace1ba50a14 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:38.465201 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-056f3d7f-bb5c-4ed4-bc6f-bace1ba50a14 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:38.465639 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-056f3d7f-bb5c-4ed4-bc6f-bace1ba50a14 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:38.584379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ef11ec61-e7eb-4303-9eba-e37a1a1914d6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:38.584946 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ef11ec61-e7eb-4303-9eba-e37a1a1914d6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:38.593835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ef11ec61-e7eb-4303-9eba-e37a1a1914d6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:38.594711 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ef11ec61-e7eb-4303-9eba-e37a1a1914d6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:38.595602 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ef11ec61-e7eb-4303-9eba-e37a1a1914d6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:38.596040 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ef11ec61-e7eb-4303-9eba-e37a1a1914d6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:38.712588 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-056f3d7f-bb5c-4ed4-bc6f-bace1ba50a14 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:38.723352 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-056f3d7f-bb5c-4ed4-bc6f-bace1ba50a14 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1735 microversion: 2.1 time: 0.274270 Aug 02 09:14:38.724567 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 219/447] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:38 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1735 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:38.802639 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ef11ec61-e7eb-4303-9eba-e37a1a1914d6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:38.812152 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ef11ec61-e7eb-4303-9eba-e37a1a1914d6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1681 microversion: 2.1 time: 0.232233 Aug 02 09:14:38.813497 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 229/448] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:38 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1681 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:39.745795 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-41452d7c-a04e-4cdb-9446-1b45bdaf1dad tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:39.747543 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-41452d7c-a04e-4cdb-9446-1b45bdaf1dad tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:39.770572 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-41452d7c-a04e-4cdb-9446-1b45bdaf1dad tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:39.771282 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-41452d7c-a04e-4cdb-9446-1b45bdaf1dad tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:39.772579 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-41452d7c-a04e-4cdb-9446-1b45bdaf1dad tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:39.773292 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-41452d7c-a04e-4cdb-9446-1b45bdaf1dad tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:39.835601 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-840116b2-9054-4ca4-a6d9-799a654201c6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:39.837002 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-840116b2-9054-4ca4-a6d9-799a654201c6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:39.846541 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-840116b2-9054-4ca4-a6d9-799a654201c6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:39.847295 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-840116b2-9054-4ca4-a6d9-799a654201c6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:39.848290 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-840116b2-9054-4ca4-a6d9-799a654201c6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:39.848895 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-840116b2-9054-4ca4-a6d9-799a654201c6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:39.946340 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-840116b2-9054-4ca4-a6d9-799a654201c6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:39.968212 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-840116b2-9054-4ca4-a6d9-799a654201c6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1614 microversion: 2.1 time: 0.136528 Aug 02 09:14:39.969304 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-41452d7c-a04e-4cdb-9446-1b45bdaf1dad tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:39.974829 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 230/449] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:39 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1614 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:39.992212 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-41452d7c-a04e-4cdb-9446-1b45bdaf1dad tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1735 microversion: 2.1 time: 0.250435 Aug 02 09:14:39.992819 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 220/450] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:39 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1735 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:40.119595 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-a2e75fcc-07bd-4b77-aee4-7d35d7629bcb req-0405623f-73a8-4a82-8890-3d3769001897 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9660960-566d-48c4-b5a7-413789e0e2c7", "name": "network-vif-deleted", "tag": "8b3c0897-2970-4809-9a52-2ac5fbdcafbe"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:40.139031 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-a2e75fcc-07bd-4b77-aee4-7d35d7629bcb req-0405623f-73a8-4a82-8890-3d3769001897 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:40.139659 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-a2e75fcc-07bd-4b77-aee4-7d35d7629bcb req-0405623f-73a8-4a82-8890-3d3769001897 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:40.157338 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-a2e75fcc-07bd-4b77-aee4-7d35d7629bcb req-0405623f-73a8-4a82-8890-3d3769001897 service nova] Creating event network-vif-deleted:8b3c0897-2970-4809-9a52-2ac5fbdcafbe for instance f9660960-566d-48c4-b5a7-413789e0e2c7 on hv-cinder-84599 Aug 02 09:14:40.175517 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-a2e75fcc-07bd-4b77-aee4-7d35d7629bcb req-0405623f-73a8-4a82-8890-3d3769001897 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059795 Aug 02 09:14:40.176047 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 231/451] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:40.993942 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-67d81db3-9e88-4a14-b928-7e4666cdbef8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:40.994694 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-67d81db3-9e88-4a14-b928-7e4666cdbef8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:41.004430 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-67d81db3-9e88-4a14-b928-7e4666cdbef8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:41.004755 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-67d81db3-9e88-4a14-b928-7e4666cdbef8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:41.010267 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-67d81db3-9e88-4a14-b928-7e4666cdbef8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:41.010267 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-67d81db3-9e88-4a14-b928-7e4666cdbef8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:41.027643 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-c9042dc9-02f5-4380-adf0-e037fc3d9f3b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:41.029380 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-c9042dc9-02f5-4380-adf0-e037fc3d9f3b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:41.041277 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c9042dc9-02f5-4380-adf0-e037fc3d9f3b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:41.044771 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c9042dc9-02f5-4380-adf0-e037fc3d9f3b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:41.044771 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c9042dc9-02f5-4380-adf0-e037fc3d9f3b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:41.044771 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c9042dc9-02f5-4380-adf0-e037fc3d9f3b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:41.083849 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-67d81db3-9e88-4a14-b928-7e4666cdbef8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:41.084379 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-67d81db3-9e88-4a14-b928-7e4666cdbef8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:41.084838 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.objects.instance [None req-67d81db3-9e88-4a14-b928-7e4666cdbef8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lazy-loading 'fault' on Instance uuid f9660960-566d-48c4-b5a7-413789e0e2c7 {{(pid=118526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:14:41.200267 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-67d81db3-9e88-4a14-b928-7e4666cdbef8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:41.223207 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-67d81db3-9e88-4a14-b928-7e4666cdbef8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 200 len: 1331 microversion: 2.1 time: 0.234125 Aug 02 09:14:41.239569 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 221/452] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:40 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 1331 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:41.295423 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-c9042dc9-02f5-4380-adf0-e037fc3d9f3b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:41.298463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:41.316987 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-c9042dc9-02f5-4380-adf0-e037fc3d9f3b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1735 microversion: 2.1 time: 0.288849 Aug 02 09:14:41.329365 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 232/453] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:41 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1735 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:42.246011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a8ba093b-0f1e-419c-9105-853011bdd3b0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:42.247376 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-a8ba093b-0f1e-419c-9105-853011bdd3b0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:42.255297 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a8ba093b-0f1e-419c-9105-853011bdd3b0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:42.256108 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a8ba093b-0f1e-419c-9105-853011bdd3b0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:42.257020 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a8ba093b-0f1e-419c-9105-853011bdd3b0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:42.257549 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a8ba093b-0f1e-419c-9105-853011bdd3b0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:42.277039 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-a8ba093b-0f1e-419c-9105-853011bdd3b0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] HTTP exception thrown: Instance f9660960-566d-48c4-b5a7-413789e0e2c7 could not be found. Aug 02 09:14:42.279156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a8ba093b-0f1e-419c-9105-853011bdd3b0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Request method failure captured: Aug 02 09:14:42.279156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 HTTP/1.1 Aug 02 09:14:42.279156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:14:42.279156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:14:42.279156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:14:42.279156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:14:42.279156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:14:42.279156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:14:42.279156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:14:42.279156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:14:42.279156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OoKOsXfjNTp1mjsj6r1IgBAgQBzTLiQjJO0bR1TldRTpxWx6tSFZWanW3Gv02s-EY-9kVRC92iBnbzPS2ztWMdgardIrvDP60IsZABewH2eMK4dXX1f7Hpv6gsaQwPQ8jW613IMovFbfYZIhNfO_yD-aTLWmHXV3Hwct_s6HofR820 Aug 02 09:14:42.279156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:14:42.279156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:14:42.279156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:14:42.279156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:14:42.279156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:14:42.279156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:14:42.279156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:14:42.279156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:14:42.279156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:14:42.279156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:14:42.280939 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6fc6b07497a48eeb263b3a9b8aa7499"}]}] Aug 02 09:14:42.280939 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:14:42.280939 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:14:42.280939 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:14:42.280939 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:14:42.280939 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:14:42.280939 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:14:42.280939 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: ad3a9141e9284bb5a096fb04d3e9d581 Aug 02 09:14:42.280939 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:14:42.280939 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:14:42.280939 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Instance f9660960-566d-48c4-b5a7-413789e0e2c7 could not be found. Aug 02 09:14:42.280939 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'id': 'f9660960-566d-48c4-b5a7-413789e0e2c7'} Aug 02 09:14:42.282847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:14:42.282847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:42.282847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:14:42.282847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:14:42.282847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:14:42.282847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:14:42.282847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:14:42.282847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:14:42.282847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:14:42.282847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:14:42.282847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9660960-566d-48c4-b5a7-413789e0e2c7 could not be found. Aug 02 09:14:42.282847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:14:42.282847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:42.282847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:14:42.282847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:42.282847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:42.282847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:42.282847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:14:42.282847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:14:42.282847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:14:42.284342 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:14:42.284342 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:14:42.284342 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:14:42.284342 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:14:42.284342 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:14:42.284342 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:14:42.284342 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:14:42.284342 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9660960-566d-48c4-b5a7-413789e0e2c7 could not be found. Aug 02 09:14:42.284342 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:14:42.284342 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:42.284342 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:14:42.284342 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:42.284342 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:42.284342 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:42.284342 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:14:42.284342 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:14:42.284342 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9660960-566d-48c4-b5a7-413789e0e2c7 could not be found. Aug 02 09:14:42.284342 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:14:42.286586 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a8ba093b-0f1e-419c-9105-853011bdd3b0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Returning 404 to user: Instance f9660960-566d-48c4-b5a7-413789e0e2c7 could not be found. {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:14:42.286586 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-a8ba093b-0f1e-419c-9105-853011bdd3b0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 404 len: 111 microversion: 2.1 time: 0.042073 Aug 02 09:14:42.286586 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 222/454] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:42 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:14:42.297865 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-f79d5591-d532-4200-a845-14c5db6bc648 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '.version_select at 0x7ffb9abedc10>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:42.345539 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-ba76ce4b-2d1c-4b7d-9037-fbfeae476aec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:42.347316 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-ba76ce4b-2d1c-4b7d-9037-fbfeae476aec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:42.355742 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ba76ce4b-2d1c-4b7d-9037-fbfeae476aec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:42.357202 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ba76ce4b-2d1c-4b7d-9037-fbfeae476aec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:42.358107 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ba76ce4b-2d1c-4b7d-9037-fbfeae476aec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:42.358955 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ba76ce4b-2d1c-4b7d-9037-fbfeae476aec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:42.400948 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-f79d5591-d532-4200-a845-14c5db6bc648 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-851894694" status: 202 len: 0 microversion: 2.1 time: 0.111022 Aug 02 09:14:42.404626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 233/455] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Aug 2 09:14:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-851894694 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:14:42.724536 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-ba76ce4b-2d1c-4b7d-9037-fbfeae476aec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:42.748586 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-ba76ce4b-2d1c-4b7d-9037-fbfeae476aec tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1735 microversion: 2.1 time: 0.410563 Aug 02 09:14:42.749531 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 223/456] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:42 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1735 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:43.775876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-2708a8f6-2748-4b08-8a83-02354bf2ce3a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:43.777490 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-2708a8f6-2748-4b08-8a83-02354bf2ce3a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:43.788517 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2708a8f6-2748-4b08-8a83-02354bf2ce3a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:43.789652 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2708a8f6-2748-4b08-8a83-02354bf2ce3a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:43.790746 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2708a8f6-2748-4b08-8a83-02354bf2ce3a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:43.791544 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2708a8f6-2748-4b08-8a83-02354bf2ce3a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:43.855464 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-4f876d58-85f6-4094-9ebc-7f63d0f51f6c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Action: 'create', calling method: .version_select at 0x7ffba1360310>, body: {"keypair": {"name": "tempest-keypair-1074134632", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0EWlv30neCHZC9FbbYOmV3QiN+fjO09UIM/7UDERE6X1LXL3gjNYi2RVY5TZXM6AfGIJReBbjflDA/NJZuwsKZGKw7wwVhlRX95ghA5z8ewitJ6gJtrTd2YYs/sXzm+A=="}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:43.884132 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-4f876d58-85f6-4094-9ebc-7f63d0f51f6c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Getting quotas for project b6fc6b07497a48eeb263b3a9b8aa7499. Resources: {'key_pairs'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:14:43.893707 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-4f876d58-85f6-4094-9ebc-7f63d0f51f6c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Getting quotas for user ad3a9141e9284bb5a096fb04d3e9d581 and project b6fc6b07497a48eeb263b3a9b8aa7499. Resources: {'key_pairs'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:14:44.058854 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-4f876d58-85f6-4094-9ebc-7f63d0f51f6c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.210769 Aug 02 09:14:44.070097 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 224/457] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 2 09:14:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:14:44.075214 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-2708a8f6-2748-4b08-8a83-02354bf2ce3a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:44.095670 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-2708a8f6-2748-4b08-8a83-02354bf2ce3a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1735 microversion: 2.1 time: 0.322884 Aug 02 09:14:44.095670 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 234/458] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:43 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1735 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:45.125542 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-29c84c0e-de82-4450-bc0e-969a012b5721 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:45.126526 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-29c84c0e-de82-4450-bc0e-969a012b5721 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:45.136432 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-29c84c0e-de82-4450-bc0e-969a012b5721 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:45.142333 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-29c84c0e-de82-4450-bc0e-969a012b5721 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:45.142333 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-29c84c0e-de82-4450-bc0e-969a012b5721 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:45.142333 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-29c84c0e-de82-4450-bc0e-969a012b5721 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:45.356438 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-29c84c0e-de82-4450-bc0e-969a012b5721 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:45.376939 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-29c84c0e-de82-4450-bc0e-969a012b5721 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1735 microversion: 2.1 time: 0.258372 Aug 02 09:14:45.378694 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 225/459] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:45 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1735 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:46.408081 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-73dbc5bc-77cf-41b5-a607-cf2a557879a1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:46.410028 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-73dbc5bc-77cf-41b5-a607-cf2a557879a1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:46.426108 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:46.432883 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-73dbc5bc-77cf-41b5-a607-cf2a557879a1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:46.435539 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-73dbc5bc-77cf-41b5-a607-cf2a557879a1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:46.438500 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-73dbc5bc-77cf-41b5-a607-cf2a557879a1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:46.439323 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-73dbc5bc-77cf-41b5-a607-cf2a557879a1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:46.713372 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-73dbc5bc-77cf-41b5-a607-cf2a557879a1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:46.736932 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-73dbc5bc-77cf-41b5-a607-cf2a557879a1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1735 microversion: 2.1 time: 0.334139 Aug 02 09:14:46.753329 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 235/460] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:46 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1735 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:47.495489 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-32cf4928-ee8f-41a0-842e-8e8fa216f2c1 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Action: 'create', calling method: .version_select at 0x7ffb9ad54790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1068068850", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIodVahepjSbbuSr4pp2MGUNY0fro5K5xStv4pTMKd+q6fEdHuKE2wmoGv4VzvhZn6b7qCt1gB07SavMCJk1aJ6cPjIq/zzOUnR1D/S4ooOGsEr854S/OiNx2/dxPMEJgg=="}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:47.525228 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-32cf4928-ee8f-41a0-842e-8e8fa216f2c1 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Getting quotas for project 8e8d4b340fc54e639758d911a5ab16a7. Resources: {'key_pairs'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:14:47.532806 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-32cf4928-ee8f-41a0-842e-8e8fa216f2c1 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Getting quotas for user c0a2b49114e0458f9625de698cc89861 and project 8e8d4b340fc54e639758d911a5ab16a7. Resources: {'key_pairs'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:14:47.659596 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-32cf4928-ee8f-41a0-842e-8e8fa216f2c1 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.527857 Aug 02 09:14:47.664814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 226/461] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 2 09:14:47 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:47.768572 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d27e488d-5b73-48cf-afb3-1f505a049be7 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:47.769926 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-d27e488d-5b73-48cf-afb3-1f505a049be7 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:47.778027 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d27e488d-5b73-48cf-afb3-1f505a049be7 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:47.778496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d27e488d-5b73-48cf-afb3-1f505a049be7 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:47.779309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d27e488d-5b73-48cf-afb3-1f505a049be7 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:47.779920 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d27e488d-5b73-48cf-afb3-1f505a049be7 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:48.040505 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d27e488d-5b73-48cf-afb3-1f505a049be7 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:48.050861 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-d27e488d-5b73-48cf-afb3-1f505a049be7 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1735 microversion: 2.1 time: 0.287005 Aug 02 09:14:48.051559 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 236/462] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:47 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1735 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:48.365925 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-66ddbc65-d530-4d92-b571-47ead5dfe8e9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1332303268", "imageRef": "7a52f4c5-c531-494a-b375-4f6dce3abbc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51ed4955-009d-4088-8f3a-112c98fc8362"}], "security_groups": [{"name": "tempest-securitygroup--305355608"}], "key_name": "tempest-keypair-1074134632", "user_data": "}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:48.497203 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.network.neutron [None req-66ddbc65-d530-4d92-b571-47ead5dfe8e9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] validate_networks() for [('51ed4955-009d-4088-8f3a-112c98fc8362', None, None, None, None, None)] {{(pid=118526) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:14:48.821158 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-8237fb9d-b274-40ea-a4af-b577023977f4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:48.821864 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-8237fb9d-b274-40ea-a4af-b577023977f4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:48.830753 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8237fb9d-b274-40ea-a4af-b577023977f4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:48.832868 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8237fb9d-b274-40ea-a4af-b577023977f4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:48.834090 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8237fb9d-b274-40ea-a4af-b577023977f4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:48.835637 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8237fb9d-b274-40ea-a4af-b577023977f4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:48.881492 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-8237fb9d-b274-40ea-a4af-b577023977f4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27/os-volume_attachments/02d010d8-9863-4d0e-8ab2-2cbc8c1fe2e9" status: 200 len: 194 microversion: 2.20 time: 0.069018 Aug 02 09:14:48.882851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 237/463] 10.222.0.20 () {60 vars in 1454 bytes} [Tue Aug 2 09:14:48 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27/os-volume_attachments/02d010d8-9863-4d0e-8ab2-2cbc8c1fe2e9 => generated 194 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:14:48.989118 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-e78b5837-9967-413e-95d5-b88acdffa88f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:48.989729 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-e78b5837-9967-413e-95d5-b88acdffa88f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:48.996554 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e78b5837-9967-413e-95d5-b88acdffa88f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:48.997096 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e78b5837-9967-413e-95d5-b88acdffa88f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:48.997959 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e78b5837-9967-413e-95d5-b88acdffa88f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:48.998548 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e78b5837-9967-413e-95d5-b88acdffa88f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:49.050482 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-66ddbc65-d530-4d92-b571-47ead5dfe8e9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Flavor limits 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:14:49.050482 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-66ddbc65-d530-4d92-b571-47ead5dfe8e9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Image limits 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:14:49.050482 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-66ddbc65-d530-4d92-b571-47ead5dfe8e9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Flavor pref 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:14:49.050482 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-66ddbc65-d530-4d92-b571-47ead5dfe8e9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Image pref 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:14:49.050482 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-66ddbc65-d530-4d92-b571-47ead5dfe8e9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:14:49.073590 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-66ddbc65-d530-4d92-b571-47ead5dfe8e9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:49.078711 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-66ddbc65-d530-4d92-b571-47ead5dfe8e9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:49.078711 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-66ddbc65-d530-4d92-b571-47ead5dfe8e9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:49.078711 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-66ddbc65-d530-4d92-b571-47ead5dfe8e9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:49.102263 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-66ddbc65-d530-4d92-b571-47ead5dfe8e9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Getting quotas for project b6fc6b07497a48eeb263b3a9b8aa7499. Resources: {'cores', 'ram', 'instances'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:14:49.111369 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-66ddbc65-d530-4d92-b571-47ead5dfe8e9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Getting quotas for user ad3a9141e9284bb5a096fb04d3e9d581 and project b6fc6b07497a48eeb263b3a9b8aa7499. Resources: {'cores', 'ram', 'instances'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:14:49.123346 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.objects.instance [None req-e78b5837-9967-413e-95d5-b88acdffa88f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lazy-loading 'services' on Instance uuid 6cca7c83-368d-4c02-a00c-d12a84825c27 {{(pid=118525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:14:49.124763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-66ddbc65-d530-4d92-b571-47ead5dfe8e9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Going to run 1 instances... {{(pid=118526) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:14:49.127670 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-66ddbc65-d530-4d92-b571-47ead5dfe8e9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7a52f4c5-c531-494a-b375-4f6dce3abbc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:14:49.247269 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-66ddbc65-d530-4d92-b571-47ead5dfe8e9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.897637 Aug 02 09:14:49.247928 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 227/464] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 2 09:14:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:14:49.254239 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b2a83771-42e3-4e16-bfbb-acda03bdab3a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:49.254239 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b2a83771-42e3-4e16-bfbb-acda03bdab3a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:49.261065 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b2a83771-42e3-4e16-bfbb-acda03bdab3a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:49.261518 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b2a83771-42e3-4e16-bfbb-acda03bdab3a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:49.262308 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b2a83771-42e3-4e16-bfbb-acda03bdab3a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:49.262752 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b2a83771-42e3-4e16-bfbb-acda03bdab3a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:49.424144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-e78b5837-9967-413e-95d5-b88acdffa88f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27/os-volume_attachments/02d010d8-9863-4d0e-8ab2-2cbc8c1fe2e9" status: 202 len: 0 microversion: 2.20 time: 0.439220 Aug 02 09:14:49.424967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 238/465] 10.222.0.20 () {60 vars in 1457 bytes} [Tue Aug 2 09:14:48 2022] DELETE /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27/os-volume_attachments/02d010d8-9863-4d0e-8ab2-2cbc8c1fe2e9 => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 02 09:14:49.434327 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-c4a86128-0143-4aaf-9a6f-199728b4ea1c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:49.435641 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-c4a86128-0143-4aaf-9a6f-199728b4ea1c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:49.502739 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b2a83771-42e3-4e16-bfbb-acda03bdab3a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:49.521485 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b2a83771-42e3-4e16-bfbb-acda03bdab3a tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1735 microversion: 2.1 time: 0.271956 Aug 02 09:14:49.522874 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 228/466] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:49 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1735 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:49.533559 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-acf937de-ac3b-427a-8e88-f738ea552513 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:49.537515 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-acf937de-ac3b-427a-8e88-f738ea552513 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:49.542000 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-c4a86128-0143-4aaf-9a6f-199728b4ea1c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:49.556115 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-c4a86128-0143-4aaf-9a6f-199728b4ea1c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 200 len: 1242 microversion: 2.1 time: 0.128486 Aug 02 09:14:49.556115 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 239/467] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:49 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 1242 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:49.561043 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-acf937de-ac3b-427a-8e88-f738ea552513 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:49.561591 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-acf937de-ac3b-427a-8e88-f738ea552513 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:49.563396 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-acf937de-ac3b-427a-8e88-f738ea552513 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:49.564138 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-acf937de-ac3b-427a-8e88-f738ea552513 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:49.604568 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-acf937de-ac3b-427a-8e88-f738ea552513 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079798 Aug 02 09:14:49.605274 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 229/468] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Aug 2 09:14:49 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:14:50.550433 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-7756a8d4-6f81-476d-bf3d-c307f3d345e5 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:50.551368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-7756a8d4-6f81-476d-bf3d-c307f3d345e5 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:50.565591 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7756a8d4-6f81-476d-bf3d-c307f3d345e5 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:50.566080 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7756a8d4-6f81-476d-bf3d-c307f3d345e5 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:50.566976 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7756a8d4-6f81-476d-bf3d-c307f3d345e5 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:50.567540 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7756a8d4-6f81-476d-bf3d-c307f3d345e5 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:50.596745 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-65ebb907-7dad-40ab-86e8-19f89474a3d5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:50.598155 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-65ebb907-7dad-40ab-86e8-19f89474a3d5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:50.611372 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-65ebb907-7dad-40ab-86e8-19f89474a3d5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:50.612757 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-65ebb907-7dad-40ab-86e8-19f89474a3d5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:50.614388 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-65ebb907-7dad-40ab-86e8-19f89474a3d5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:50.615358 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-65ebb907-7dad-40ab-86e8-19f89474a3d5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:50.780398 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-65ebb907-7dad-40ab-86e8-19f89474a3d5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:50.793444 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-65ebb907-7dad-40ab-86e8-19f89474a3d5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 200 len: 1246 microversion: 2.1 time: 0.204458 Aug 02 09:14:50.808708 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 230/469] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:50 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 1246 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:50.818615 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-e0c6726f-5984-4c26-8553-d86701039c39 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:50.821727 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-e0c6726f-5984-4c26-8553-d86701039c39 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:50.831793 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e0c6726f-5984-4c26-8553-d86701039c39 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:50.832713 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e0c6726f-5984-4c26-8553-d86701039c39 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:50.833779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e0c6726f-5984-4c26-8553-d86701039c39 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:50.834462 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e0c6726f-5984-4c26-8553-d86701039c39 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:50.918292 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-7756a8d4-6f81-476d-bf3d-c307f3d345e5 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:50.932919 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-e0c6726f-5984-4c26-8553-d86701039c39 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.122172 Aug 02 09:14:50.940987 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-7756a8d4-6f81-476d-bf3d-c307f3d345e5 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1735 microversion: 2.1 time: 0.398077 Aug 02 09:14:50.960207 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 240/470] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:50 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1735 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:50.960681 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 231/471] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Aug 2 09:14:50 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:14:51.823729 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-0da150ce-bb27-45a9-8087-358e2f1a3b3d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:51.824383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-0da150ce-bb27-45a9-8087-358e2f1a3b3d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:51.832626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0da150ce-bb27-45a9-8087-358e2f1a3b3d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:51.833082 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0da150ce-bb27-45a9-8087-358e2f1a3b3d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:51.833879 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0da150ce-bb27-45a9-8087-358e2f1a3b3d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:51.834310 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0da150ce-bb27-45a9-8087-358e2f1a3b3d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:51.922510 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-0da150ce-bb27-45a9-8087-358e2f1a3b3d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:51.932172 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-0da150ce-bb27-45a9-8087-358e2f1a3b3d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 200 len: 1294 microversion: 2.1 time: 0.111955 Aug 02 09:14:51.933258 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 241/472] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:51 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 1294 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:51.964451 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-6e262ffa-18ca-414e-b7a2-c83d7cfc4003 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:51.966896 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-6e262ffa-18ca-414e-b7a2-c83d7cfc4003 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:51.981429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6e262ffa-18ca-414e-b7a2-c83d7cfc4003 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:51.981920 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6e262ffa-18ca-414e-b7a2-c83d7cfc4003 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:51.982793 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6e262ffa-18ca-414e-b7a2-c83d7cfc4003 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:51.983224 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6e262ffa-18ca-414e-b7a2-c83d7cfc4003 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:51.985461 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-2019b17e-2d09-4708-8d46-086065be741e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:51.986542 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-2019b17e-2d09-4708-8d46-086065be741e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:51.996470 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2019b17e-2d09-4708-8d46-086065be741e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:51.996891 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2019b17e-2d09-4708-8d46-086065be741e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:52.000152 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2019b17e-2d09-4708-8d46-086065be741e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:52.001422 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2019b17e-2d09-4708-8d46-086065be741e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:52.034849 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-6e262ffa-18ca-414e-b7a2-c83d7cfc4003 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.079086 Aug 02 09:14:52.035427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 232/473] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Aug 2 09:14:51 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27/os-volume_attachments => generated 25 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:14:52.136492 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-fc1bd01c-448f-452e-8e93-8ee3337a4deb tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:52.137067 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-fc1bd01c-448f-452e-8e93-8ee3337a4deb tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:52.146427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fc1bd01c-448f-452e-8e93-8ee3337a4deb tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:52.147142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fc1bd01c-448f-452e-8e93-8ee3337a4deb tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:52.148257 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fc1bd01c-448f-452e-8e93-8ee3337a4deb tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:52.148961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fc1bd01c-448f-452e-8e93-8ee3337a4deb tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:52.180746 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-fc1bd01c-448f-452e-8e93-8ee3337a4deb tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Going to try to terminate instance {{(pid=118526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:14:52.240924 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-2019b17e-2d09-4708-8d46-086065be741e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:52.249940 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-2019b17e-2d09-4708-8d46-086065be741e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1735 microversion: 2.1 time: 0.275807 Aug 02 09:14:52.250535 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 242/474] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:51 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1735 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:52.512635 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-fc1bd01c-448f-452e-8e93-8ee3337a4deb tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 204 len: 0 microversion: 2.20 time: 0.380340 Aug 02 09:14:52.518347 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 233/475] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Aug 2 09:14:52 2022] DELETE /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 02 09:14:52.524148 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-679ae9ab-dc68-4b55-a1bd-1ebe28ab9e89 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:52.524805 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-679ae9ab-dc68-4b55-a1bd-1ebe28ab9e89 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:52.532100 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-679ae9ab-dc68-4b55-a1bd-1ebe28ab9e89 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:52.532595 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-679ae9ab-dc68-4b55-a1bd-1ebe28ab9e89 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:52.533407 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-679ae9ab-dc68-4b55-a1bd-1ebe28ab9e89 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:52.534082 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-679ae9ab-dc68-4b55-a1bd-1ebe28ab9e89 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:52.781672 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-679ae9ab-dc68-4b55-a1bd-1ebe28ab9e89 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:52.810676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-679ae9ab-dc68-4b55-a1bd-1ebe28ab9e89 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:52.815252 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-679ae9ab-dc68-4b55-a1bd-1ebe28ab9e89 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:52.817067 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-679ae9ab-dc68-4b55-a1bd-1ebe28ab9e89 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1723 microversion: 2.20 time: 0.296700 Aug 02 09:14:52.828662 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 243/476] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:52 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1723 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:52.973765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-eb41771d-a322-4ff9-ba92-7e2eabac7e63 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:52.976286 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-eb41771d-a322-4ff9-ba92-7e2eabac7e63 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:52.990481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-eb41771d-a322-4ff9-ba92-7e2eabac7e63 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:52.990911 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-eb41771d-a322-4ff9-ba92-7e2eabac7e63 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:52.991702 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-eb41771d-a322-4ff9-ba92-7e2eabac7e63 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:52.993302 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-eb41771d-a322-4ff9-ba92-7e2eabac7e63 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:53.080486 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-eb41771d-a322-4ff9-ba92-7e2eabac7e63 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:53.091284 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-eb41771d-a322-4ff9-ba92-7e2eabac7e63 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 200 len: 1302 microversion: 2.1 time: 0.129398 Aug 02 09:14:53.091913 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 234/477] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:52 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 1302 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:53.276475 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-8f6716ca-37ce-4340-aa22-b0e3d2188f51 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:53.277463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-8f6716ca-37ce-4340-aa22-b0e3d2188f51 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:53.290750 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8f6716ca-37ce-4340-aa22-b0e3d2188f51 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:53.291449 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8f6716ca-37ce-4340-aa22-b0e3d2188f51 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:53.292571 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8f6716ca-37ce-4340-aa22-b0e3d2188f51 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:53.293098 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8f6716ca-37ce-4340-aa22-b0e3d2188f51 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:53.486740 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-8f6716ca-37ce-4340-aa22-b0e3d2188f51 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:53.500980 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-8f6716ca-37ce-4340-aa22-b0e3d2188f51 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1735 microversion: 2.1 time: 0.232191 Aug 02 09:14:53.501568 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 244/478] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:53 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1735 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:53.861299 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-9ee9e314-ced6-4639-b2ad-2413a25b5af0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:53.861899 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-9ee9e314-ced6-4639-b2ad-2413a25b5af0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:53.868285 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9ee9e314-ced6-4639-b2ad-2413a25b5af0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:53.868726 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9ee9e314-ced6-4639-b2ad-2413a25b5af0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:53.869509 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9ee9e314-ced6-4639-b2ad-2413a25b5af0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:53.869935 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9ee9e314-ced6-4639-b2ad-2413a25b5af0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:54.022179 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-9ee9e314-ced6-4639-b2ad-2413a25b5af0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:54.030466 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-9ee9e314-ced6-4639-b2ad-2413a25b5af0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:54.032888 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-9ee9e314-ced6-4639-b2ad-2413a25b5af0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:54.034081 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-9ee9e314-ced6-4639-b2ad-2413a25b5af0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1723 microversion: 2.20 time: 0.177555 Aug 02 09:14:54.034638 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 235/479] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:53 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:54.115392 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-db39efa9-eafe-439b-a7e5-ad9af91e0893 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:54.115977 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-db39efa9-eafe-439b-a7e5-ad9af91e0893 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:54.122381 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-db39efa9-eafe-439b-a7e5-ad9af91e0893 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:54.122921 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-db39efa9-eafe-439b-a7e5-ad9af91e0893 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:54.123599 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-db39efa9-eafe-439b-a7e5-ad9af91e0893 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:54.124026 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-db39efa9-eafe-439b-a7e5-ad9af91e0893 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:54.195794 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-db39efa9-eafe-439b-a7e5-ad9af91e0893 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:54.204121 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-db39efa9-eafe-439b-a7e5-ad9af91e0893 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 200 len: 1302 microversion: 2.1 time: 0.092876 Aug 02 09:14:54.204724 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 245/480] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:54 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 1302 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:54.528806 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-2ba3455d-faa2-4038-8fe0-53f32dc4b8ca tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:54.529755 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-2ba3455d-faa2-4038-8fe0-53f32dc4b8ca tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:54.537635 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2ba3455d-faa2-4038-8fe0-53f32dc4b8ca tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:54.538084 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2ba3455d-faa2-4038-8fe0-53f32dc4b8ca tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:54.538863 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2ba3455d-faa2-4038-8fe0-53f32dc4b8ca tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:54.539303 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2ba3455d-faa2-4038-8fe0-53f32dc4b8ca tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:54.710341 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-2ba3455d-faa2-4038-8fe0-53f32dc4b8ca tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:54.713420 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:54.726304 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-2ba3455d-faa2-4038-8fe0-53f32dc4b8ca tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1735 microversion: 2.1 time: 0.204814 Aug 02 09:14:54.727570 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 236/481] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:54 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:55.058130 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d436ef0f-c408-4b79-a804-3b9d548882e8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:55.058726 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-d436ef0f-c408-4b79-a804-3b9d548882e8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:55.067042 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d436ef0f-c408-4b79-a804-3b9d548882e8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:55.068317 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d436ef0f-c408-4b79-a804-3b9d548882e8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:55.068317 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d436ef0f-c408-4b79-a804-3b9d548882e8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:55.068762 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d436ef0f-c408-4b79-a804-3b9d548882e8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:55.234568 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-eaf137c4-4b7b-4f1f-ac1a-4a86aa86dbdf tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:55.235718 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-eaf137c4-4b7b-4f1f-ac1a-4a86aa86dbdf tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:55.243191 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d436ef0f-c408-4b79-a804-3b9d548882e8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:55.248046 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-eaf137c4-4b7b-4f1f-ac1a-4a86aa86dbdf tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:55.250762 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-eaf137c4-4b7b-4f1f-ac1a-4a86aa86dbdf tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:55.251706 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-eaf137c4-4b7b-4f1f-ac1a-4a86aa86dbdf tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:55.251978 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-eaf137c4-4b7b-4f1f-ac1a-4a86aa86dbdf tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:55.267273 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d436ef0f-c408-4b79-a804-3b9d548882e8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:55.272261 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d436ef0f-c408-4b79-a804-3b9d548882e8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:55.275029 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-d436ef0f-c408-4b79-a804-3b9d548882e8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1723 microversion: 2.20 time: 0.220434 Aug 02 09:14:55.277477 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 246/482] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:55 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:55.411411 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-eaf137c4-4b7b-4f1f-ac1a-4a86aa86dbdf tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:55.431169 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-eaf137c4-4b7b-4f1f-ac1a-4a86aa86dbdf tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 200 len: 1312 microversion: 2.1 time: 0.204626 Aug 02 09:14:55.433255 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 237/483] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:55 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 1312 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:55.775965 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ab28eb9c-8826-4549-b1b5-7c6f08f3b55e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:55.787220 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ab28eb9c-8826-4549-b1b5-7c6f08f3b55e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:55.814375 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ab28eb9c-8826-4549-b1b5-7c6f08f3b55e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:55.819467 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ab28eb9c-8826-4549-b1b5-7c6f08f3b55e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:55.819467 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ab28eb9c-8826-4549-b1b5-7c6f08f3b55e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:55.822513 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ab28eb9c-8826-4549-b1b5-7c6f08f3b55e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:56.080307 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ab28eb9c-8826-4549-b1b5-7c6f08f3b55e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:56.091984 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ab28eb9c-8826-4549-b1b5-7c6f08f3b55e tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1715 microversion: 2.1 time: 0.338431 Aug 02 09:14:56.092590 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 247/484] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:55 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1715 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:56.308344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c58ee521-e075-4c64-9d12-de0d4b57876b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:56.308968 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-c58ee521-e075-4c64-9d12-de0d4b57876b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:56.316935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-972bb6ed-84ba-425d-a5b0-97ce68c8233b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:56.323655 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-972bb6ed-84ba-425d-a5b0-97ce68c8233b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:56.332312 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-972bb6ed-84ba-425d-a5b0-97ce68c8233b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:56.332776 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-972bb6ed-84ba-425d-a5b0-97ce68c8233b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:56.333688 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-972bb6ed-84ba-425d-a5b0-97ce68c8233b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:56.341606 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c58ee521-e075-4c64-9d12-de0d4b57876b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:56.342132 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c58ee521-e075-4c64-9d12-de0d4b57876b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:56.342872 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c58ee521-e075-4c64-9d12-de0d4b57876b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:56.343355 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c58ee521-e075-4c64-9d12-de0d4b57876b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:56.346115 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-972bb6ed-84ba-425d-a5b0-97ce68c8233b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:56.461403 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-972bb6ed-84ba-425d-a5b0-97ce68c8233b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:56.475852 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-972bb6ed-84ba-425d-a5b0-97ce68c8233b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:56.477805 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-972bb6ed-84ba-425d-a5b0-97ce68c8233b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:56.479292 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-972bb6ed-84ba-425d-a5b0-97ce68c8233b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1655 microversion: 2.20 time: 0.167827 Aug 02 09:14:56.485074 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 248/485] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:56 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1655 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:14:56.525807 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-2e8f1036-8752-40b4-8585-fa42e2928395 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:56.529029 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-2e8f1036-8752-40b4-8585-fa42e2928395 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:56.545640 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2e8f1036-8752-40b4-8585-fa42e2928395 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:56.546953 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2e8f1036-8752-40b4-8585-fa42e2928395 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:56.550194 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2e8f1036-8752-40b4-8585-fa42e2928395 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:56.551197 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2e8f1036-8752-40b4-8585-fa42e2928395 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:56.700310 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-c58ee521-e075-4c64-9d12-de0d4b57876b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] HTTP exception thrown: Cannot 'detach_volume' instance 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d while it is in vm_state rescued Aug 02 09:14:56.709590 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c58ee521-e075-4c64-9d12-de0d4b57876b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Request method failure captured: Aug 02 09:14:56.709590 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: DELETE /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d/os-volume_attachments/83808ea6-072c-432e-8823-374952b9e43d HTTP/1.1 Aug 02 09:14:56.709590 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:14:56.709590 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:14:56.709590 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:14:56.709590 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:14:56.709590 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:14:56.709590 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:14:56.709590 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:14:56.709590 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:14:56.709590 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OoRmwjoNYhYnEcpgvvMEgd2xKWzF42xFe2mQGMLj3xIf2rbW7jLb_M6K5s8XRrNt0jgV2BkoLp__0sW_xWvmzuZaSam16BGZbPOtbFV1QdDLxB4qZlviKTAjvfQC9uvL31nkGmI2TvBy6_wRRQkKYA6ErGyVZGDEB2BoL_ZMmAWEOk Aug 02 09:14:56.709590 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:14:56.709590 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:14:56.709590 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:14:56.709590 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:14:56.709590 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:14:56.709590 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:14:56.709590 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: 5b01727cea94442bb62b56e7a4ae57a0 Aug 02 09:14:56.709590 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1040473499 Aug 02 09:14:56.709590 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:14:56.709590 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:14:56.710846 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b01727cea94442bb62b56e7a4ae57a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b01727cea94442bb62b56e7a4ae57a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b01727cea94442bb62b56e7a4ae57a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b01727cea94442bb62b56e7a4ae57a0"}]}] Aug 02 09:14:56.710846 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1040473499 Aug 02 09:14:56.710846 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: 5b01727cea94442bb62b56e7a4ae57a0 Aug 02 09:14:56.710846 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1040473499 Aug 02 09:14:56.710846 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-ServerRescueNegativeTestJSON-1040473499-project Aug 02 09:14:56.710846 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:14:56.710846 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:14:56.710846 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: 1eda94767d1547fa82f6407a4c7de1d8 Aug 02 09:14:56.710846 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1040473499-project Aug 02 09:14:56.710846 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:14:56.710846 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Cannot 'detach_volume' instance 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d while it is in vm_state rescued Aug 02 09:14:56.711734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'server_id': '351f0943-3d4a-43c0-a57d-2e0bdda1fc4d', 'id': '83808ea6-072c-432e-8823-374952b9e43d'} Aug 02 09:14:56.711734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:14:56.711734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:56.711734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 02 09:14:56.711734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 02 09:14:56.711734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 09:14:56.711734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:14:56.711734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 02 09:14:56.711734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 02 09:14:56.711734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 02 09:14:56.711734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:14:56.711734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:56.711734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:14:56.711734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:56.711734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:56.711734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:56.711734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:14:56.711734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:14:56.711734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:14:56.711734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:14:56.712996 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 02 09:14:56.712996 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 02 09:14:56.712996 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 02 09:14:56.712996 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 02 09:14:56.712996 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d while it is in vm_state rescued Aug 02 09:14:56.712996 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:14:56.712996 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:56.712996 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:14:56.712996 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:56.712996 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:56.712996 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:56.712996 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:14:56.712996 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:14:56.712996 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d while it is in vm_state rescued Aug 02 09:14:56.712996 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:14:56.712996 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c58ee521-e075-4c64-9d12-de0d4b57876b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Returning 409 to user: Cannot 'detach_volume' instance 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d while it is in vm_state rescued {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:14:56.719470 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-c58ee521-e075-4c64-9d12-de0d4b57876b tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "DELETE /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d/os-volume_attachments/83808ea6-072c-432e-8823-374952b9e43d" status: 409 len: 152 microversion: 2.1 time: 0.411133 Aug 02 09:14:56.719470 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 238/486] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 2 09:14:56 2022] DELETE /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d/os-volume_attachments/83808ea6-072c-432e-8823-374952b9e43d => generated 152 bytes in 417 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 02 09:14:56.729904 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c0cb3c9a-3d3e-41d9-92cb-abf63b508fbd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:56.733878 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-c0cb3c9a-3d3e-41d9-92cb-abf63b508fbd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:56.762855 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c0cb3c9a-3d3e-41d9-92cb-abf63b508fbd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:56.764093 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c0cb3c9a-3d3e-41d9-92cb-abf63b508fbd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:56.766835 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c0cb3c9a-3d3e-41d9-92cb-abf63b508fbd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:56.767942 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c0cb3c9a-3d3e-41d9-92cb-abf63b508fbd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:57.047599 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-2e8f1036-8752-40b4-8585-fa42e2928395 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:57.061004 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-2e8f1036-8752-40b4-8585-fa42e2928395 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 200 len: 1367 microversion: 2.1 time: 0.573533 Aug 02 09:14:57.062134 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 249/487] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:56 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 1367 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:57.067495 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-243f48c8-5b75-4dbd-8bb9-aff19406c354 req-ec4294ca-55d6-428d-92a6-b13acc8d08a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cca7c83-368d-4c02-a00c-d12a84825c27", "name": "network-vif-deleted", "tag": "8f442acd-437f-4082-97ec-7f28749a0a8b"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:57.080854 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-243f48c8-5b75-4dbd-8bb9-aff19406c354 req-ec4294ca-55d6-428d-92a6-b13acc8d08a0 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:57.082662 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-243f48c8-5b75-4dbd-8bb9-aff19406c354 req-ec4294ca-55d6-428d-92a6-b13acc8d08a0 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:57.102735 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-243f48c8-5b75-4dbd-8bb9-aff19406c354 req-ec4294ca-55d6-428d-92a6-b13acc8d08a0 service nova] Creating event network-vif-deleted:8f442acd-437f-4082-97ec-7f28749a0a8b for instance 6cca7c83-368d-4c02-a00c-d12a84825c27 on hv-cinder-84599 Aug 02 09:14:57.120403 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-243f48c8-5b75-4dbd-8bb9-aff19406c354 req-ec4294ca-55d6-428d-92a6-b13acc8d08a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055828 Aug 02 09:14:57.121703 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 250/488] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:14:57.137897 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-c0cb3c9a-3d3e-41d9-92cb-abf63b508fbd tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "POST /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d/action" status: 202 len: 0 microversion: 2.1 time: 0.415330 Aug 02 09:14:57.139061 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 239/489] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 2 09:14:56 2022] POST /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:14:57.166741 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-e506ef21-610a-49ac-bdd9-5cb0bcb06534 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:57.168240 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-e506ef21-610a-49ac-bdd9-5cb0bcb06534 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:57.180894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e506ef21-610a-49ac-bdd9-5cb0bcb06534 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:57.187899 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e506ef21-610a-49ac-bdd9-5cb0bcb06534 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:57.187899 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e506ef21-610a-49ac-bdd9-5cb0bcb06534 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:57.187899 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e506ef21-610a-49ac-bdd9-5cb0bcb06534 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:57.215121 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:57.517805 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-7a5cc495-770c-4cf8-9363-1ae83a7ff00e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:57.524472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-7a5cc495-770c-4cf8-9363-1ae83a7ff00e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:57.551752 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7a5cc495-770c-4cf8-9363-1ae83a7ff00e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:57.552856 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7a5cc495-770c-4cf8-9363-1ae83a7ff00e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:57.556293 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7a5cc495-770c-4cf8-9363-1ae83a7ff00e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:57.557097 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7a5cc495-770c-4cf8-9363-1ae83a7ff00e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:57.559777 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-e506ef21-610a-49ac-bdd9-5cb0bcb06534 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:57.606213 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-e506ef21-610a-49ac-bdd9-5cb0bcb06534 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1723 microversion: 2.1 time: 0.445285 Aug 02 09:14:57.610073 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 251/490] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:57 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1723 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:57.641032 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:57.644298 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7a5cc495-770c-4cf8-9363-1ae83a7ff00e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:57.647182 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7a5cc495-770c-4cf8-9363-1ae83a7ff00e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:57.647968 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.objects.instance [None req-7a5cc495-770c-4cf8-9363-1ae83a7ff00e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lazy-loading 'fault' on Instance uuid 6cca7c83-368d-4c02-a00c-d12a84825c27 {{(pid=118526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:14:57.698324 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-7a5cc495-770c-4cf8-9363-1ae83a7ff00e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:57.709593 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-7a5cc495-770c-4cf8-9363-1ae83a7ff00e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:57.711151 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-7a5cc495-770c-4cf8-9363-1ae83a7ff00e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:57.712830 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-7a5cc495-770c-4cf8-9363-1ae83a7ff00e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 200 len: 1370 microversion: 2.20 time: 0.208188 Aug 02 09:14:57.713640 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 240/491] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:57 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 1370 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:14:58.092215 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-a681a65d-b9ae-4edd-941f-2ae39ebf9b10 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:58.094039 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-a681a65d-b9ae-4edd-941f-2ae39ebf9b10 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:58.102922 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a681a65d-b9ae-4edd-941f-2ae39ebf9b10 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:58.103972 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a681a65d-b9ae-4edd-941f-2ae39ebf9b10 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:58.105382 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a681a65d-b9ae-4edd-941f-2ae39ebf9b10 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:58.106426 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a681a65d-b9ae-4edd-941f-2ae39ebf9b10 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:58.207548 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-a6452245-e011-423f-a843-3ee4c269243d req-62354f16-a417-4d46-b882-0c30975fefe4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0331a7cf-074f-4e27-b452-e057f9b422c5", "tag": "a3478fbe-d4f8-4edb-bd8f-4af63ca7a8d1"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:14:58.227081 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-a6452245-e011-423f-a843-3ee4c269243d req-62354f16-a417-4d46-b882-0c30975fefe4 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:58.228479 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-a6452245-e011-423f-a843-3ee4c269243d req-62354f16-a417-4d46-b882-0c30975fefe4 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:58.249658 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-a6452245-e011-423f-a843-3ee4c269243d req-62354f16-a417-4d46-b882-0c30975fefe4 service nova] Creating event network-changed:a3478fbe-d4f8-4edb-bd8f-4af63ca7a8d1 for instance 0331a7cf-074f-4e27-b452-e057f9b422c5 on hv-cinder-84599 Aug 02 09:14:58.259385 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-a6452245-e011-423f-a843-3ee4c269243d req-62354f16-a417-4d46-b882-0c30975fefe4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059489 Aug 02 09:14:58.261691 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 241/492] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:14:58.491655 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-a681a65d-b9ae-4edd-941f-2ae39ebf9b10 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:58.501919 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-a681a65d-b9ae-4edd-941f-2ae39ebf9b10 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 200 len: 1367 microversion: 2.1 time: 0.417312 Aug 02 09:14:58.502348 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 252/493] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:58 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 1367 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:58.634758 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-4968655a-e82b-445d-9e49-1e2180a3d471 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:58.635728 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-4968655a-e82b-445d-9e49-1e2180a3d471 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:58.644901 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4968655a-e82b-445d-9e49-1e2180a3d471 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:58.645832 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4968655a-e82b-445d-9e49-1e2180a3d471 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:58.647849 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4968655a-e82b-445d-9e49-1e2180a3d471 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:58.648714 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4968655a-e82b-445d-9e49-1e2180a3d471 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:58.755827 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-f0e6d519-dbc3-496c-ad48-5454b9fb66d9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:58.756465 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-f0e6d519-dbc3-496c-ad48-5454b9fb66d9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:58.763367 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f0e6d519-dbc3-496c-ad48-5454b9fb66d9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:58.764061 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f0e6d519-dbc3-496c-ad48-5454b9fb66d9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:58.765085 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f0e6d519-dbc3-496c-ad48-5454b9fb66d9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:58.765690 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f0e6d519-dbc3-496c-ad48-5454b9fb66d9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:58.780742 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-f0e6d519-dbc3-496c-ad48-5454b9fb66d9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] HTTP exception thrown: Instance 6cca7c83-368d-4c02-a00c-d12a84825c27 could not be found. Aug 02 09:14:58.782780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-f0e6d519-dbc3-496c-ad48-5454b9fb66d9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Request method failure captured: Aug 02 09:14:58.782780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 HTTP/1.1 Aug 02 09:14:58.782780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:14:58.782780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:14:58.782780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:14:58.782780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:14:58.782780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:14:58.782780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:14:58.782780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:14:58.782780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:14:58.782780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6OoRT2KmPOrbFwi17IerArjCVuPRvNuR_ftdfux-dglsWpzjnybStZVi73M6KoPiMnSPwswC3oPIk2nAftEkrc45NeUE0vfe39o3Ba-J-4bw7BGpvYXczGIMGnYpIRDEnnQ1Hg0tHLBummYQaRlFeZPdww-C2_01n4KUnUWFlWfKaVY Aug 02 09:14:58.782780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:14:58.782780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:14:58.782780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:14:58.782780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:14:58.782780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 09:14:58.782780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:14:58.782780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:14:58.782780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: 06061d6914ac4b86841d45162ceeb89f Aug 02 09:14:58.782780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1976077308 Aug 02 09:14:58.782780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:14:58.782780 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:14:58.784410 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/06061d6914ac4b86841d45162ceeb89f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/06061d6914ac4b86841d45162ceeb89f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/06061d6914ac4b86841d45162ceeb89f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_06061d6914ac4b86841d45162ceeb89f"}]}] Aug 02 09:14:58.784410 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1976077308 Aug 02 09:14:58.784410 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: 06061d6914ac4b86841d45162ceeb89f Aug 02 09:14:58.784410 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1976077308 Aug 02 09:14:58.784410 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-AttachVolumeShelveTestJSON-1976077308-project Aug 02 09:14:58.784410 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:14:58.784410 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:14:58.784410 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: 4a1a40ef55434cd48a2dc4385880fe0b Aug 02 09:14:58.784410 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1976077308-project Aug 02 09:14:58.784410 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: > Aug 02 09:14:58.784410 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Instance 6cca7c83-368d-4c02-a00c-d12a84825c27 could not be found. Aug 02 09:14:58.784410 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': '6cca7c83-368d-4c02-a00c-d12a84825c27'} Aug 02 09:14:58.795284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:14:58.795284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:58.795284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:14:58.795284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:14:58.795284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:14:58.795284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:14:58.795284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:14:58.795284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:14:58.795284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:14:58.795284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:14:58.795284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cca7c83-368d-4c02-a00c-d12a84825c27 could not be found. Aug 02 09:14:58.795284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:14:58.795284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:58.795284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:14:58.795284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:58.795284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:58.795284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:58.795284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:14:58.795284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:14:58.795284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:14:58.797221 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:14:58.797221 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:14:58.797221 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:14:58.797221 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:14:58.797221 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:14:58.797221 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:14:58.797221 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:14:58.797221 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cca7c83-368d-4c02-a00c-d12a84825c27 could not be found. Aug 02 09:14:58.797221 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:14:58.797221 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:14:58.797221 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:14:58.797221 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:14:58.797221 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:14:58.797221 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:14:58.797221 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:14:58.797221 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:14:58.797221 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cca7c83-368d-4c02-a00c-d12a84825c27 could not be found. Aug 02 09:14:58.797221 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:14:58.798485 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-f0e6d519-dbc3-496c-ad48-5454b9fb66d9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Returning 404 to user: Instance 6cca7c83-368d-4c02-a00c-d12a84825c27 could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:14:58.798485 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-f0e6d519-dbc3-496c-ad48-5454b9fb66d9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 404 len: 111 microversion: 2.20 time: 0.034154 Aug 02 09:14:58.798485 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 253/494] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:14:58 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 02 09:14:58.799813 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4eb71e25-8795-4d94-abc2-a0abd61fec1e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '.version_select at 0x7ffb9aafd940>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:58.838591 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-4968655a-e82b-445d-9e49-1e2180a3d471 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:58.847755 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-4968655a-e82b-445d-9e49-1e2180a3d471 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1723 microversion: 2.1 time: 0.220535 Aug 02 09:14:58.848500 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 242/495] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:58 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:58.908644 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-4eb71e25-8795-4d94-abc2-a0abd61fec1e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-182077312" status: 204 len: 0 microversion: 2.20 time: 0.116771 Aug 02 09:14:58.909639 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 254/496] 10.222.0.20 () {60 vars in 1259 bytes} [Tue Aug 2 09:14:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-182077312 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 02 09:14:59.523469 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-51531b71-5d9e-4bd4-9484-eb569f720d6c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:59.524279 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-51531b71-5d9e-4bd4-9484-eb569f720d6c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:59.526495 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=2 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:59.527276 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=14 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:59.533412 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-51531b71-5d9e-4bd4-9484-eb569f720d6c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:59.533984 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-51531b71-5d9e-4bd4-9484-eb569f720d6c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:59.535032 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-51531b71-5d9e-4bd4-9484-eb569f720d6c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:59.539537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-51531b71-5d9e-4bd4-9484-eb569f720d6c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:59.802339 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-51531b71-5d9e-4bd4-9484-eb569f720d6c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:14:59.810543 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-51531b71-5d9e-4bd4-9484-eb569f720d6c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 200 len: 1367 microversion: 2.1 time: 0.291498 Aug 02 09:14:59.811174 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 243/497] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:59 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:14:59.868136 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=2 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:14:59.873045 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-21657ce0-c3b3-4ab3-bdc8-e8da4605c698 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:14:59.873899 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-21657ce0-c3b3-4ab3-bdc8-e8da4605c698 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:14:59.883099 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-21657ce0-c3b3-4ab3-bdc8-e8da4605c698 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:59.883587 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-21657ce0-c3b3-4ab3-bdc8-e8da4605c698 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:14:59.884464 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-21657ce0-c3b3-4ab3-bdc8-e8da4605c698 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:14:59.884916 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-21657ce0-c3b3-4ab3-bdc8-e8da4605c698 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:00.385563 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-ec9d2e62-df99-4dab-889f-b056e1686c47 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Action: 'create', calling method: .version_select at 0x7ffb9ab5d670>, body: {"keypair": {"name": "tempest-keypair-959951953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5ApV+TmYzDJ0Kp/NtrM5qRcsf4FOFPTBgxOzH09GDKJhlrY24GVcBVdEnYjw/VJ+xCsTM6CaqKHd+cmrle1RvCS1bNYIjxUWBkKDQ314IwWXMELBeVNYFGTf7Hn1SHKA=="}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:00.402069 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-ec9d2e62-df99-4dab-889f-b056e1686c47 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Getting quotas for project 06061d6914ac4b86841d45162ceeb89f. Resources: {'key_pairs'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:15:00.406715 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-ec9d2e62-df99-4dab-889f-b056e1686c47 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Getting quotas for user 4a1a40ef55434cd48a2dc4385880fe0b and project 06061d6914ac4b86841d45162ceeb89f. Resources: {'key_pairs'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:15:00.426940 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-21657ce0-c3b3-4ab3-bdc8-e8da4605c698 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:00.445793 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-21657ce0-c3b3-4ab3-bdc8-e8da4605c698 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1723 microversion: 2.1 time: 0.578456 Aug 02 09:15:00.446907 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 255/498] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:14:59 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1723 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:00.503123 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-ec9d2e62-df99-4dab-889f-b056e1686c47 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.121652 Aug 02 09:15:00.503727 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 244/499] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Aug 2 09:15:00 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 123 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 02 09:15:00.834812 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-a1f49521-c0e2-405c-bbcb-630ec1a7a3cc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:00.835658 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-a1f49521-c0e2-405c-bbcb-630ec1a7a3cc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:00.844720 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a1f49521-c0e2-405c-bbcb-630ec1a7a3cc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:00.845165 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a1f49521-c0e2-405c-bbcb-630ec1a7a3cc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:00.845955 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a1f49521-c0e2-405c-bbcb-630ec1a7a3cc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:00.846386 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a1f49521-c0e2-405c-bbcb-630ec1a7a3cc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:01.084965 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-a1f49521-c0e2-405c-bbcb-630ec1a7a3cc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:01.101942 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-a1f49521-c0e2-405c-bbcb-630ec1a7a3cc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 200 len: 1367 microversion: 2.1 time: 0.272756 Aug 02 09:15:01.102542 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 256/500] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:00 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:01.471480 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-cb426c71-b598-45c5-80a8-4bc0d7a08f34 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:01.472482 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-cb426c71-b598-45c5-80a8-4bc0d7a08f34 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:01.479692 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cb426c71-b598-45c5-80a8-4bc0d7a08f34 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:01.480365 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cb426c71-b598-45c5-80a8-4bc0d7a08f34 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:01.481021 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cb426c71-b598-45c5-80a8-4bc0d7a08f34 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:01.481442 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cb426c71-b598-45c5-80a8-4bc0d7a08f34 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:01.649944 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-cb426c71-b598-45c5-80a8-4bc0d7a08f34 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:01.661148 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-cb426c71-b598-45c5-80a8-4bc0d7a08f34 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1729 microversion: 2.1 time: 0.194477 Aug 02 09:15:01.662200 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 245/501] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:01 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:01.705815 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ad97f792-1ea3-42bc-95dc-61e7f2cb6787 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:01.706707 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ad97f792-1ea3-42bc-95dc-61e7f2cb6787 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:01.717776 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ad97f792-1ea3-42bc-95dc-61e7f2cb6787 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:01.719043 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ad97f792-1ea3-42bc-95dc-61e7f2cb6787 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:01.720535 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ad97f792-1ea3-42bc-95dc-61e7f2cb6787 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:01.721316 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ad97f792-1ea3-42bc-95dc-61e7f2cb6787 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:01.857872 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ad97f792-1ea3-42bc-95dc-61e7f2cb6787 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.161074 Aug 02 09:15:01.858501 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 257/502] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Aug 2 09:15:01 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d/os-interface => generated 284 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:02.130214 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c26b8ca1-3399-45a9-992b-f267892552a8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:02.130214 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-c26b8ca1-3399-45a9-992b-f267892552a8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:02.134025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c26b8ca1-3399-45a9-992b-f267892552a8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:02.134767 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c26b8ca1-3399-45a9-992b-f267892552a8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:02.135842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c26b8ca1-3399-45a9-992b-f267892552a8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:02.136569 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c26b8ca1-3399-45a9-992b-f267892552a8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:02.426571 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-c26b8ca1-3399-45a9-992b-f267892552a8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:02.439030 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-c26b8ca1-3399-45a9-992b-f267892552a8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 200 len: 1367 microversion: 2.1 time: 0.318440 Aug 02 09:15:02.440147 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 246/503] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:02 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 1367 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:03.160551 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-e59bd71d-7543-4803-947e-adc032f3d3d3 req-61721f38-dd64-4b86-ad0d-95cc6da7f780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "351f0943-3d4a-43c0-a57d-2e0bdda1fc4d", "tag": "7fd2e01d-97ab-4034-89c5-5069ee9e9915"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:03.181292 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-e59bd71d-7543-4803-947e-adc032f3d3d3 req-61721f38-dd64-4b86-ad0d-95cc6da7f780 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:03.181956 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-e59bd71d-7543-4803-947e-adc032f3d3d3 req-61721f38-dd64-4b86-ad0d-95cc6da7f780 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:03.205106 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-e59bd71d-7543-4803-947e-adc032f3d3d3 req-61721f38-dd64-4b86-ad0d-95cc6da7f780 service nova] Creating event network-changed:7fd2e01d-97ab-4034-89c5-5069ee9e9915 for instance 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d on hv-cinder-84599 Aug 02 09:15:03.210876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-e59bd71d-7543-4803-947e-adc032f3d3d3 req-61721f38-dd64-4b86-ad0d-95cc6da7f780 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054102 Aug 02 09:15:03.212271 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 258/504] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:03.465434 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-2a83506b-dd2e-4d85-8855-eb2a332567e1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:03.466664 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-2a83506b-dd2e-4d85-8855-eb2a332567e1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:03.474388 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2a83506b-dd2e-4d85-8855-eb2a332567e1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:03.474916 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2a83506b-dd2e-4d85-8855-eb2a332567e1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:03.475754 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2a83506b-dd2e-4d85-8855-eb2a332567e1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:03.476220 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2a83506b-dd2e-4d85-8855-eb2a332567e1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:03.639755 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-f541f686-f5b5-45f7-91c6-549644f03d29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1952355559", "imageRef": "7a52f4c5-c531-494a-b375-4f6dce3abbc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "07600d7a-420e-401f-8c47-198c159c9e44"}], "security_groups": [{"name": "tempest-securitygroup--1865315095"}], "key_name": "tempest-keypair-959951953", "user_data": "}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:03.763877 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-2a83506b-dd2e-4d85-8855-eb2a332567e1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:03.777381 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-2a83506b-dd2e-4d85-8855-eb2a332567e1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 200 len: 1367 microversion: 2.1 time: 0.316032 Aug 02 09:15:03.790024 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 247/505] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:03 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 1367 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:03.856423 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.network.neutron [None req-f541f686-f5b5-45f7-91c6-549644f03d29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] validate_networks() for [('07600d7a-420e-401f-8c47-198c159c9e44', None, None, None, None, None)] {{(pid=118525) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:15:04.446148 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-f541f686-f5b5-45f7-91c6-549644f03d29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Flavor limits 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:15:04.447429 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-f541f686-f5b5-45f7-91c6-549644f03d29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Image limits 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:15:04.447429 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-f541f686-f5b5-45f7-91c6-549644f03d29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Flavor pref 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:15:04.451545 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-f541f686-f5b5-45f7-91c6-549644f03d29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Image pref 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:15:04.451545 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-f541f686-f5b5-45f7-91c6-549644f03d29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:15:04.462983 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f541f686-f5b5-45f7-91c6-549644f03d29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:04.463575 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f541f686-f5b5-45f7-91c6-549644f03d29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:04.464499 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f541f686-f5b5-45f7-91c6-549644f03d29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:04.464935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f541f686-f5b5-45f7-91c6-549644f03d29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:04.485611 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-f541f686-f5b5-45f7-91c6-549644f03d29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Getting quotas for project 06061d6914ac4b86841d45162ceeb89f. Resources: {'cores', 'ram', 'instances'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:15:04.490132 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-f541f686-f5b5-45f7-91c6-549644f03d29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Getting quotas for user 4a1a40ef55434cd48a2dc4385880fe0b and project 06061d6914ac4b86841d45162ceeb89f. Resources: {'cores', 'ram', 'instances'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:15:04.503244 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-f541f686-f5b5-45f7-91c6-549644f03d29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Going to run 1 instances... {{(pid=118525) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:15:04.505756 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-f541f686-f5b5-45f7-91c6-549644f03d29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7a52f4c5-c531-494a-b375-4f6dce3abbc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118525) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:15:04.743473 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-f541f686-f5b5-45f7-91c6-549644f03d29 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.108651 Aug 02 09:15:04.744132 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 259/506] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Aug 2 09:15:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 1110 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 02 09:15:04.756624 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-827f3047-7eb4-49d2-85fc-8402d5b09289 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:04.757317 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-827f3047-7eb4-49d2-85fc-8402d5b09289 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:04.800596 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-0b6847a0-39d2-46bd-810e-e8e6fed67cbc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:04.801518 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-0b6847a0-39d2-46bd-810e-e8e6fed67cbc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:04.810536 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0b6847a0-39d2-46bd-810e-e8e6fed67cbc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:04.811233 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0b6847a0-39d2-46bd-810e-e8e6fed67cbc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:04.813046 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0b6847a0-39d2-46bd-810e-e8e6fed67cbc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:04.813759 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0b6847a0-39d2-46bd-810e-e8e6fed67cbc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:04.821868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-827f3047-7eb4-49d2-85fc-8402d5b09289 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:04.836633 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-827f3047-7eb4-49d2-85fc-8402d5b09289 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:04.840529 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-827f3047-7eb4-49d2-85fc-8402d5b09289 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:04.841018 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-827f3047-7eb4-49d2-85fc-8402d5b09289 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1281 microversion: 2.20 time: 0.088705 Aug 02 09:15:04.841723 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 248/507] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:15:04 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1281 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:15:04.981211 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-0b6847a0-39d2-46bd-810e-e8e6fed67cbc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:04.989524 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-0b6847a0-39d2-46bd-810e-e8e6fed67cbc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 200 len: 1367 microversion: 2.1 time: 0.194311 Aug 02 09:15:04.990090 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 260/508] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:04 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:05.230597 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-d0cb57e5-3afc-4ed5-9d97-84500d9e1d0b req-ddfa4920-76c5-40c6-9e51-84eb8cfa9022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "351f0943-3d4a-43c0-a57d-2e0bdda1fc4d", "tag": "7fd2e01d-97ab-4034-89c5-5069ee9e9915"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:05.250701 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-d0cb57e5-3afc-4ed5-9d97-84500d9e1d0b req-ddfa4920-76c5-40c6-9e51-84eb8cfa9022 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:05.251501 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-d0cb57e5-3afc-4ed5-9d97-84500d9e1d0b req-ddfa4920-76c5-40c6-9e51-84eb8cfa9022 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:05.274309 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-d0cb57e5-3afc-4ed5-9d97-84500d9e1d0b req-ddfa4920-76c5-40c6-9e51-84eb8cfa9022 service nova] Creating event network-changed:7fd2e01d-97ab-4034-89c5-5069ee9e9915 for instance 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d on hv-cinder-84599 Aug 02 09:15:05.283653 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-d0cb57e5-3afc-4ed5-9d97-84500d9e1d0b req-ddfa4920-76c5-40c6-9e51-84eb8cfa9022 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060021 Aug 02 09:15:05.284596 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 249/509] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:05.378549 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-76627e3c-4821-4ede-96b4-cfca4166f55c req-a36b0019-10d8-4ef5-bffe-cc5685918770 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0331a7cf-074f-4e27-b452-e057f9b422c5", "name": "network-vif-plugged", "status": "completed", "tag": "a3478fbe-d4f8-4edb-bd8f-4af63ca7a8d1"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:05.401501 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-76627e3c-4821-4ede-96b4-cfca4166f55c req-a36b0019-10d8-4ef5-bffe-cc5685918770 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:05.402042 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-76627e3c-4821-4ede-96b4-cfca4166f55c req-a36b0019-10d8-4ef5-bffe-cc5685918770 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:05.414554 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-76627e3c-4821-4ede-96b4-cfca4166f55c req-a36b0019-10d8-4ef5-bffe-cc5685918770 service nova] Creating event network-vif-plugged:a3478fbe-d4f8-4edb-bd8f-4af63ca7a8d1 for instance 0331a7cf-074f-4e27-b452-e057f9b422c5 on hv-cinder-84599 Aug 02 09:15:05.419918 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-76627e3c-4821-4ede-96b4-cfca4166f55c req-a36b0019-10d8-4ef5-bffe-cc5685918770 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047827 Aug 02 09:15:05.420595 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 261/510] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:05.865830 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-558b23ad-8c01-4e81-b566-69db9c84d187 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:05.871205 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-558b23ad-8c01-4e81-b566-69db9c84d187 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:05.874502 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-558b23ad-8c01-4e81-b566-69db9c84d187 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:05.874965 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-558b23ad-8c01-4e81-b566-69db9c84d187 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:05.875766 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-558b23ad-8c01-4e81-b566-69db9c84d187 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:05.876240 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-558b23ad-8c01-4e81-b566-69db9c84d187 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:06.013733 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-c528a1d4-14ab-4c7d-bdcf-030f2cb37124 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:06.015014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-c528a1d4-14ab-4c7d-bdcf-030f2cb37124 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:06.023076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c528a1d4-14ab-4c7d-bdcf-030f2cb37124 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:06.023572 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c528a1d4-14ab-4c7d-bdcf-030f2cb37124 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:06.024494 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c528a1d4-14ab-4c7d-bdcf-030f2cb37124 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:06.024942 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c528a1d4-14ab-4c7d-bdcf-030f2cb37124 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:06.212597 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-558b23ad-8c01-4e81-b566-69db9c84d187 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:06.222890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-558b23ad-8c01-4e81-b566-69db9c84d187 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:06.224443 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-558b23ad-8c01-4e81-b566-69db9c84d187 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:06.225552 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-558b23ad-8c01-4e81-b566-69db9c84d187 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1285 microversion: 2.20 time: 0.364015 Aug 02 09:15:06.226106 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 250/511] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:15:05 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1285 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:15:06.337098 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-c528a1d4-14ab-4c7d-bdcf-030f2cb37124 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:06.347062 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-c528a1d4-14ab-4c7d-bdcf-030f2cb37124 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 200 len: 1367 microversion: 2.1 time: 0.339032 Aug 02 09:15:06.347698 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 262/512] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:06 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 1367 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:07.248011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-936d6ae2-cbec-4bac-889f-0aa3f9067a2b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:07.248011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-936d6ae2-cbec-4bac-889f-0aa3f9067a2b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:07.255554 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-936d6ae2-cbec-4bac-889f-0aa3f9067a2b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:07.256008 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-936d6ae2-cbec-4bac-889f-0aa3f9067a2b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:07.256824 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-936d6ae2-cbec-4bac-889f-0aa3f9067a2b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:07.257262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-936d6ae2-cbec-4bac-889f-0aa3f9067a2b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:07.323049 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-936d6ae2-cbec-4bac-889f-0aa3f9067a2b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:07.331799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-936d6ae2-cbec-4bac-889f-0aa3f9067a2b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:07.333335 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-936d6ae2-cbec-4bac-889f-0aa3f9067a2b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:07.334446 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-936d6ae2-cbec-4bac-889f-0aa3f9067a2b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1333 microversion: 2.20 time: 0.091390 Aug 02 09:15:07.334994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 251/513] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:15:07 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1333 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:15:07.367867 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-fcb661b8-741d-457a-b3e2-f7b53b2ac6a2 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:07.368638 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-fcb661b8-741d-457a-b3e2-f7b53b2ac6a2 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:07.376707 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fcb661b8-741d-457a-b3e2-f7b53b2ac6a2 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:07.377166 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fcb661b8-741d-457a-b3e2-f7b53b2ac6a2 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:07.377944 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fcb661b8-741d-457a-b3e2-f7b53b2ac6a2 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:07.378382 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fcb661b8-741d-457a-b3e2-f7b53b2ac6a2 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:07.526918 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-fcb661b8-741d-457a-b3e2-f7b53b2ac6a2 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:07.535947 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-fcb661b8-741d-457a-b3e2-f7b53b2ac6a2 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 200 len: 1367 microversion: 2.1 time: 0.172143 Aug 02 09:15:07.536671 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 263/514] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:07 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:07.680339 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-faef21fc-1760-4787-83d0-5bb3d93ce6dd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:07.681001 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-faef21fc-1760-4787-83d0-5bb3d93ce6dd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:07.687954 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-faef21fc-1760-4787-83d0-5bb3d93ce6dd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:07.688442 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-faef21fc-1760-4787-83d0-5bb3d93ce6dd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:07.689242 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-faef21fc-1760-4787-83d0-5bb3d93ce6dd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:07.689688 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-faef21fc-1760-4787-83d0-5bb3d93ce6dd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:07.782392 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.objects.instance [None req-faef21fc-1760-4787-83d0-5bb3d93ce6dd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lazy-loading 'services' on Instance uuid 73c852c4-c5c3-4a1f-94b9-f6515a830bbb {{(pid=118526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:15:08.102576 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-faef21fc-1760-4787-83d0-5bb3d93ce6dd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "DELETE /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb/os-volume_attachments/d789b6ff-110a-48c0-867a-b2ab1dcf2eef" status: 202 len: 0 microversion: 2.1 time: 0.425999 Aug 02 09:15:08.103093 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 252/515] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 2 09:15:07 2022] DELETE /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb/os-volume_attachments/d789b6ff-110a-48c0-867a-b2ab1dcf2eef => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:15:08.361494 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-73e8e7ab-6dcb-441f-9a6e-2b60ccee8e96 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:08.363545 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-73e8e7ab-6dcb-441f-9a6e-2b60ccee8e96 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:08.377197 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-73e8e7ab-6dcb-441f-9a6e-2b60ccee8e96 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:08.380989 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-73e8e7ab-6dcb-441f-9a6e-2b60ccee8e96 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:08.380989 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-73e8e7ab-6dcb-441f-9a6e-2b60ccee8e96 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:08.380989 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-73e8e7ab-6dcb-441f-9a6e-2b60ccee8e96 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:08.475093 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-73e8e7ab-6dcb-441f-9a6e-2b60ccee8e96 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:08.486382 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-73e8e7ab-6dcb-441f-9a6e-2b60ccee8e96 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:08.487943 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-73e8e7ab-6dcb-441f-9a6e-2b60ccee8e96 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:08.489176 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-73e8e7ab-6dcb-441f-9a6e-2b60ccee8e96 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1341 microversion: 2.20 time: 0.135362 Aug 02 09:15:08.489920 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 264/516] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:15:08 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1341 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:15:08.559135 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-3ca7b960-bcf4-4275-95bf-b1404feee463 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:08.559890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-3ca7b960-bcf4-4275-95bf-b1404feee463 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:08.567137 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3ca7b960-bcf4-4275-95bf-b1404feee463 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:08.567585 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3ca7b960-bcf4-4275-95bf-b1404feee463 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:08.568418 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3ca7b960-bcf4-4275-95bf-b1404feee463 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:08.569085 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3ca7b960-bcf4-4275-95bf-b1404feee463 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:08.721247 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-3ca7b960-bcf4-4275-95bf-b1404feee463 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:08.727402 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d275e7d5-c5e4-427d-bccf-09a7e3cf4b93 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1888309843", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1068068850", "security_groups": [{"name": "tempest-secgroup-smoke-1032874180"}], "block_device_mapping_v2": [{"uuid": "741241e0-37d7-4473-a6dd-e9f16becfc12", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "591148ac-b480-44cf-8cb3-9d42c0440114"}]}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:08.729536 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-3ca7b960-bcf4-4275-95bf-b1404feee463 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 200 len: 1557 microversion: 2.1 time: 0.175110 Aug 02 09:15:08.730194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 253/517] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:08 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 1557 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:08.751721 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-666dcae0-9b6e-4d16-92f3-e5339f5df12c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:08.752240 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-666dcae0-9b6e-4d16-92f3-e5339f5df12c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:08.759171 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-666dcae0-9b6e-4d16-92f3-e5339f5df12c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:08.759618 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-666dcae0-9b6e-4d16-92f3-e5339f5df12c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:08.760438 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-666dcae0-9b6e-4d16-92f3-e5339f5df12c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:08.760868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-666dcae0-9b6e-4d16-92f3-e5339f5df12c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:09.000889 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-666dcae0-9b6e-4d16-92f3-e5339f5df12c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.251407 Aug 02 09:15:09.002099 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 254/518] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Aug 2 09:15:08 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5/os-interface => generated 284 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:15:09.007634 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.network.neutron [None req-d275e7d5-c5e4-427d-bccf-09a7e3cf4b93 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] validate_networks() for [('591148ac-b480-44cf-8cb3-9d42c0440114', None, None, None, None, None)] {{(pid=118525) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:15:09.522313 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b978df65-b30a-4764-8734-a02daa7266e9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:09.523461 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b978df65-b30a-4764-8734-a02daa7266e9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:09.535775 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b978df65-b30a-4764-8734-a02daa7266e9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:09.536613 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b978df65-b30a-4764-8734-a02daa7266e9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:09.538339 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b978df65-b30a-4764-8734-a02daa7266e9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:09.539211 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b978df65-b30a-4764-8734-a02daa7266e9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:09.548626 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:09.677081 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b978df65-b30a-4764-8734-a02daa7266e9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:09.695543 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b978df65-b30a-4764-8734-a02daa7266e9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:09.699163 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b978df65-b30a-4764-8734-a02daa7266e9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:09.702054 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b978df65-b30a-4764-8734-a02daa7266e9 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1339 microversion: 2.20 time: 0.190012 Aug 02 09:15:09.716467 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 255/519] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:15:09 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1339 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:15:09.942808 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-d275e7d5-c5e4-427d-bccf-09a7e3cf4b93 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Flavor limits 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:15:09.944121 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-d275e7d5-c5e4-427d-bccf-09a7e3cf4b93 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Image limits 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:15:09.945139 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-d275e7d5-c5e4-427d-bccf-09a7e3cf4b93 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Flavor pref 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:15:09.945878 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-d275e7d5-c5e4-427d-bccf-09a7e3cf4b93 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Image pref 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:15:09.947546 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-d275e7d5-c5e4-427d-bccf-09a7e3cf4b93 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:15:09.962954 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d275e7d5-c5e4-427d-bccf-09a7e3cf4b93 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:10.063406 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d275e7d5-c5e4-427d-bccf-09a7e3cf4b93 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:10.063406 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d275e7d5-c5e4-427d-bccf-09a7e3cf4b93 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:10.063406 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d275e7d5-c5e4-427d-bccf-09a7e3cf4b93 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:10.063406 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-d275e7d5-c5e4-427d-bccf-09a7e3cf4b93 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Getting quotas for project 8e8d4b340fc54e639758d911a5ab16a7. Resources: {'cores', 'ram', 'instances'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:15:10.063932 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-d275e7d5-c5e4-427d-bccf-09a7e3cf4b93 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Getting quotas for user c0a2b49114e0458f9625de698cc89861 and project 8e8d4b340fc54e639758d911a5ab16a7. Resources: {'cores', 'ram', 'instances'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:15:10.078703 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-d275e7d5-c5e4-427d-bccf-09a7e3cf4b93 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Going to run 1 instances... {{(pid=118525) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:15:10.082051 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-d275e7d5-c5e4-427d-bccf-09a7e3cf4b93 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='741241e0-37d7-4473-a6dd-e9f16becfc12',volume_size=None,volume_type=None)] {{(pid=118525) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:15:10.361762 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-166e56f4-7773-4816-8200-44c1b56bdc5c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:10.374783 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-166e56f4-7773-4816-8200-44c1b56bdc5c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:10.375807 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-166e56f4-7773-4816-8200-44c1b56bdc5c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:10.413468 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-166e56f4-7773-4816-8200-44c1b56bdc5c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Going to try to stop instance {{(pid=118526) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 02 09:15:10.698113 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-166e56f4-7773-4816-8200-44c1b56bdc5c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "POST /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb/action" status: 202 len: 0 microversion: 2.1 time: 0.344708 Aug 02 09:15:10.699836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 256/520] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 2 09:15:10 2022] POST /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:15:10.711564 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-55f3f3a2-456f-4643-a169-28c7b85ec0d4 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:10.714041 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-55f3f3a2-456f-4643-a169-28c7b85ec0d4 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:10.741105 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-55f3f3a2-456f-4643-a169-28c7b85ec0d4 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:10.741932 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-55f3f3a2-456f-4643-a169-28c7b85ec0d4 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:10.752403 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-55f3f3a2-456f-4643-a169-28c7b85ec0d4 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:10.752403 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-55f3f3a2-456f-4643-a169-28c7b85ec0d4 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:10.759883 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-d275e7d5-c5e4-427d-bccf-09a7e3cf4b93 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.037764 Aug 02 09:15:10.761049 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 265/521] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 2 09:15:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 2040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 09:15:10.767937 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-a61ba46b-89e4-4481-8011-9ea48816ea66 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:10.769052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-a61ba46b-89e4-4481-8011-9ea48816ea66 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:10.807439 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a61ba46b-89e4-4481-8011-9ea48816ea66 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:10.814251 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a61ba46b-89e4-4481-8011-9ea48816ea66 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:10.814251 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a61ba46b-89e4-4481-8011-9ea48816ea66 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:10.814251 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a61ba46b-89e4-4481-8011-9ea48816ea66 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:11.195032 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-55f3f3a2-456f-4643-a169-28c7b85ec0d4 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:11.201171 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-a61ba46b-89e4-4481-8011-9ea48816ea66 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:11.219589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-55f3f3a2-456f-4643-a169-28c7b85ec0d4 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1674 microversion: 2.1 time: 0.513646 Aug 02 09:15:11.223887 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-a61ba46b-89e4-4481-8011-9ea48816ea66 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:11.240583 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 257/522] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:10 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1674 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:11.260045 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-a9dcd2e6-45e0-405b-8c80-10e6bb6e0763 req-b9135cfe-a5c7-4f75-b20a-6414ee7f4e60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0331a7cf-074f-4e27-b452-e057f9b422c5", "tag": "a3478fbe-d4f8-4edb-bd8f-4af63ca7a8d1"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:11.260280 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-a61ba46b-89e4-4481-8011-9ea48816ea66 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:11.260280 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-a61ba46b-89e4-4481-8011-9ea48816ea66 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1407 microversion: 2.20 time: 0.491235 Aug 02 09:15:11.260280 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 266/523] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:15:10 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1407 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:15:11.260280 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-23a3c3bf-ba72-48d1-8374-99a3cba82701 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:11.260902 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-23a3c3bf-ba72-48d1-8374-99a3cba82701 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:11.263258 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:11.290981 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-a9dcd2e6-45e0-405b-8c80-10e6bb6e0763 req-b9135cfe-a5c7-4f75-b20a-6414ee7f4e60 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:11.291444 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-a9dcd2e6-45e0-405b-8c80-10e6bb6e0763 req-b9135cfe-a5c7-4f75-b20a-6414ee7f4e60 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:11.323643 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-a9dcd2e6-45e0-405b-8c80-10e6bb6e0763 req-b9135cfe-a5c7-4f75-b20a-6414ee7f4e60 service nova] Creating event network-changed:a3478fbe-d4f8-4edb-bd8f-4af63ca7a8d1 for instance 0331a7cf-074f-4e27-b452-e057f9b422c5 on hv-cinder-84599 Aug 02 09:15:11.336772 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-a9dcd2e6-45e0-405b-8c80-10e6bb6e0763 req-b9135cfe-a5c7-4f75-b20a-6414ee7f4e60 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091687 Aug 02 09:15:11.339985 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 258/524] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:11.370139 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-23a3c3bf-ba72-48d1-8374-99a3cba82701 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:11.394501 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-23a3c3bf-ba72-48d1-8374-99a3cba82701 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 200 len: 1095 microversion: 2.1 time: 0.137837 Aug 02 09:15:11.406931 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 267/525] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:11 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 1095 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:12.109210 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-36c0e890-93df-435c-9290-9efb28581ca8 req-24fa9355-ccb3-4862-bc3e-dd00b4d37aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b54fded6-ca19-48e6-b971-31f061cce0c5", "tag": "021d8483-0afc-44b7-b117-6f61fcf5696d"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:12.122970 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-36c0e890-93df-435c-9290-9efb28581ca8 req-24fa9355-ccb3-4862-bc3e-dd00b4d37aa6 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:12.127035 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-36c0e890-93df-435c-9290-9efb28581ca8 req-24fa9355-ccb3-4862-bc3e-dd00b4d37aa6 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:12.149229 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-36c0e890-93df-435c-9290-9efb28581ca8 req-24fa9355-ccb3-4862-bc3e-dd00b4d37aa6 service nova] Creating event network-changed:021d8483-0afc-44b7-b117-6f61fcf5696d for instance b54fded6-ca19-48e6-b971-31f061cce0c5 on hv-cinder-84599 Aug 02 09:15:12.157521 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-36c0e890-93df-435c-9290-9efb28581ca8 req-24fa9355-ccb3-4862-bc3e-dd00b4d37aa6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053122 Aug 02 09:15:12.159568 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 259/526] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:12.249431 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-8d36ac8c-c41e-44fa-90a3-7e1f0d49bf7a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:12.251469 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-8d36ac8c-c41e-44fa-90a3-7e1f0d49bf7a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:12.260433 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8d36ac8c-c41e-44fa-90a3-7e1f0d49bf7a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:12.261073 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8d36ac8c-c41e-44fa-90a3-7e1f0d49bf7a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:12.261861 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8d36ac8c-c41e-44fa-90a3-7e1f0d49bf7a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:12.262290 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8d36ac8c-c41e-44fa-90a3-7e1f0d49bf7a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:12.313860 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-8f49f214-b8f4-467e-a91b-d7377654fc5f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:12.315043 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-8f49f214-b8f4-467e-a91b-d7377654fc5f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:12.322504 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-8f49f214-b8f4-467e-a91b-d7377654fc5f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:12.323231 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-8f49f214-b8f4-467e-a91b-d7377654fc5f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:12.324253 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-8f49f214-b8f4-467e-a91b-d7377654fc5f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:12.324702 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-8f49f214-b8f4-467e-a91b-d7377654fc5f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:12.665037 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-8d36ac8c-c41e-44fa-90a3-7e1f0d49bf7a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:12.673751 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-8d36ac8c-c41e-44fa-90a3-7e1f0d49bf7a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1674 microversion: 2.1 time: 0.429365 Aug 02 09:15:12.674347 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 268/527] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:12 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1674 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:12.679001 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-8bf545c6-c056-47b7-9bf3-56f1cbda0bc0 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:12.679618 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-8bf545c6-c056-47b7-9bf3-56f1cbda0bc0 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:12.685953 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8bf545c6-c056-47b7-9bf3-56f1cbda0bc0 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:12.686561 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8bf545c6-c056-47b7-9bf3-56f1cbda0bc0 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:12.687465 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8bf545c6-c056-47b7-9bf3-56f1cbda0bc0 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:12.687993 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8bf545c6-c056-47b7-9bf3-56f1cbda0bc0 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:12.719915 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-8f49f214-b8f4-467e-a91b-d7377654fc5f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:12.735350 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-8f49f214-b8f4-467e-a91b-d7377654fc5f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:12.736953 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-8f49f214-b8f4-467e-a91b-d7377654fc5f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:12.738180 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-8f49f214-b8f4-467e-a91b-d7377654fc5f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1407 microversion: 2.20 time: 0.430527 Aug 02 09:15:12.743341 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 260/528] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:15:12 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1407 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:15:12.807432 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-8bf545c6-c056-47b7-9bf3-56f1cbda0bc0 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:12.816852 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-8bf545c6-c056-47b7-9bf3-56f1cbda0bc0 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 200 len: 1145 microversion: 2.1 time: 0.141312 Aug 02 09:15:12.817695 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 269/529] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:12 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 1145 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:13.697531 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-498e186a-4b37-4dc9-87df-e5e210ff0b5c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:13.698081 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-498e186a-4b37-4dc9-87df-e5e210ff0b5c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:13.705080 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-498e186a-4b37-4dc9-87df-e5e210ff0b5c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:13.705536 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-498e186a-4b37-4dc9-87df-e5e210ff0b5c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:13.706318 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-498e186a-4b37-4dc9-87df-e5e210ff0b5c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:13.706754 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-498e186a-4b37-4dc9-87df-e5e210ff0b5c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:13.761608 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-46c35349-c63e-44fb-8da6-0096acd6366e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:13.764583 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-46c35349-c63e-44fb-8da6-0096acd6366e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:13.770354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-46c35349-c63e-44fb-8da6-0096acd6366e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:13.771121 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-46c35349-c63e-44fb-8da6-0096acd6366e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:13.772110 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-46c35349-c63e-44fb-8da6-0096acd6366e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:13.772579 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-46c35349-c63e-44fb-8da6-0096acd6366e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:13.891769 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-498e186a-4b37-4dc9-87df-e5e210ff0b5c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:13.900118 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-498e186a-4b37-4dc9-87df-e5e210ff0b5c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1674 microversion: 2.1 time: 0.206486 Aug 02 09:15:13.912332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 261/530] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:13 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1674 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:13.912332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-fe7f7ad0-e76d-4a11-b5c0-3e6c2b80457f tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:13.912332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-fe7f7ad0-e76d-4a11-b5c0-3e6c2b80457f tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:13.912725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fe7f7ad0-e76d-4a11-b5c0-3e6c2b80457f tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:13.913240 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fe7f7ad0-e76d-4a11-b5c0-3e6c2b80457f tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:13.914119 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fe7f7ad0-e76d-4a11-b5c0-3e6c2b80457f tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:13.914635 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fe7f7ad0-e76d-4a11-b5c0-3e6c2b80457f tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:13.943536 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-46c35349-c63e-44fb-8da6-0096acd6366e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:13.952264 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-46c35349-c63e-44fb-8da6-0096acd6366e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:13.954172 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-46c35349-c63e-44fb-8da6-0096acd6366e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:13.955236 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-46c35349-c63e-44fb-8da6-0096acd6366e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1407 microversion: 2.20 time: 0.198138 Aug 02 09:15:13.956202 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 270/531] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:15:13 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:15:13.982501 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-fe7f7ad0-e76d-4a11-b5c0-3e6c2b80457f tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:13.990235 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-fe7f7ad0-e76d-4a11-b5c0-3e6c2b80457f tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 200 len: 1193 microversion: 2.1 time: 0.088121 Aug 02 09:15:13.991037 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 262/532] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:13 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 1193 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:14.925227 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ed0bfdc3-8250-4da5-b77e-2ae846252187 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:14.925871 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ed0bfdc3-8250-4da5-b77e-2ae846252187 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:14.932755 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ed0bfdc3-8250-4da5-b77e-2ae846252187 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:14.933197 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ed0bfdc3-8250-4da5-b77e-2ae846252187 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:14.933964 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ed0bfdc3-8250-4da5-b77e-2ae846252187 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:14.934397 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ed0bfdc3-8250-4da5-b77e-2ae846252187 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:14.977963 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a0d45599-ebaf-4698-b1b8-ed3957090dfc tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:14.978668 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-a0d45599-ebaf-4698-b1b8-ed3957090dfc tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:14.980964 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=6 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:14.986776 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a0d45599-ebaf-4698-b1b8-ed3957090dfc tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:14.987199 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a0d45599-ebaf-4698-b1b8-ed3957090dfc tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:14.987974 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a0d45599-ebaf-4698-b1b8-ed3957090dfc tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:14.988466 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a0d45599-ebaf-4698-b1b8-ed3957090dfc tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:15.486404 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ed0bfdc3-8250-4da5-b77e-2ae846252187 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:15.494664 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ed0bfdc3-8250-4da5-b77e-2ae846252187 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1674 microversion: 2.1 time: 0.573798 Aug 02 09:15:15.495263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 271/533] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:14 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1674 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:15.512504 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-a03c9935-4855-4d3d-b86a-4a1c8af5debe tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:15.513067 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-a03c9935-4855-4d3d-b86a-4a1c8af5debe tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:15.521572 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a03c9935-4855-4d3d-b86a-4a1c8af5debe tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:15.522065 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a03c9935-4855-4d3d-b86a-4a1c8af5debe tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:15.523235 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a03c9935-4855-4d3d-b86a-4a1c8af5debe tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:15.523750 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a03c9935-4855-4d3d-b86a-4a1c8af5debe tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:15.532150 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-a0d45599-ebaf-4698-b1b8-ed3957090dfc tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:15.544093 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-a0d45599-ebaf-4698-b1b8-ed3957090dfc tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:15.546819 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-a0d45599-ebaf-4698-b1b8-ed3957090dfc tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:15.548248 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-a0d45599-ebaf-4698-b1b8-ed3957090dfc tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1407 microversion: 2.20 time: 0.574089 Aug 02 09:15:15.548964 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 263/534] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:15:14 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1407 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:15:15.618711 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-a03c9935-4855-4d3d-b86a-4a1c8af5debe tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:15.628559 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-a03c9935-4855-4d3d-b86a-4a1c8af5debe tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 200 len: 1211 microversion: 2.1 time: 0.120924 Aug 02 09:15:15.628559 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 272/535] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:15 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 1211 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:16.522165 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-5dbd922d-d5bb-41e6-bffd-a0c22cbbbc15 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:16.522798 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-5dbd922d-d5bb-41e6-bffd-a0c22cbbbc15 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:16.529832 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5dbd922d-d5bb-41e6-bffd-a0c22cbbbc15 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:16.530569 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5dbd922d-d5bb-41e6-bffd-a0c22cbbbc15 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:16.531468 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5dbd922d-d5bb-41e6-bffd-a0c22cbbbc15 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:16.531844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5dbd922d-d5bb-41e6-bffd-a0c22cbbbc15 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:16.572968 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-bca38f2f-a676-4920-9104-2df12886bcb4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:16.573504 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-bca38f2f-a676-4920-9104-2df12886bcb4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:16.585209 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bca38f2f-a676-4920-9104-2df12886bcb4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:16.585209 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bca38f2f-a676-4920-9104-2df12886bcb4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:16.585209 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bca38f2f-a676-4920-9104-2df12886bcb4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:16.585209 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bca38f2f-a676-4920-9104-2df12886bcb4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:16.885698 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-5dbd922d-d5bb-41e6-bffd-a0c22cbbbc15 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:16.898058 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-5dbd922d-d5bb-41e6-bffd-a0c22cbbbc15 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1674 microversion: 2.1 time: 0.379735 Aug 02 09:15:16.898913 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 264/536] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:16 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1674 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:16.904142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-1db7e880-c471-48eb-8c9e-20041fd1f9f6 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:16.904824 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-1db7e880-c471-48eb-8c9e-20041fd1f9f6 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:16.917392 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1db7e880-c471-48eb-8c9e-20041fd1f9f6 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:16.918187 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1db7e880-c471-48eb-8c9e-20041fd1f9f6 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:16.919598 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1db7e880-c471-48eb-8c9e-20041fd1f9f6 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:16.920414 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1db7e880-c471-48eb-8c9e-20041fd1f9f6 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:16.939574 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-bca38f2f-a676-4920-9104-2df12886bcb4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:16.944420 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=100 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:16.957562 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-bca38f2f-a676-4920-9104-2df12886bcb4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:16.961354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-bca38f2f-a676-4920-9104-2df12886bcb4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:16.964091 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-bca38f2f-a676-4920-9104-2df12886bcb4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1407 microversion: 2.20 time: 0.395354 Aug 02 09:15:16.965392 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 273/537] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:15:16 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1407 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:15:17.151135 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-1db7e880-c471-48eb-8c9e-20041fd1f9f6 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:17.160337 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-1db7e880-c471-48eb-8c9e-20041fd1f9f6 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 200 len: 1279 microversion: 2.1 time: 0.260227 Aug 02 09:15:17.160969 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 265/538] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:16 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 1279 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:17.591109 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-aacdf4b3-8eed-4733-8917-249ee4032f91 req-c916b718-fad5-42a4-a8d0-da344a83ac90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cee14a35-0425-48c3-9e4e-efed2fdd23a1", "tag": "99bf6922-c8df-418b-91be-5f5d1aeea287"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:17.603153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-aacdf4b3-8eed-4733-8917-249ee4032f91 req-c916b718-fad5-42a4-a8d0-da344a83ac90 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:17.603623 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-aacdf4b3-8eed-4733-8917-249ee4032f91 req-c916b718-fad5-42a4-a8d0-da344a83ac90 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:17.616998 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-aacdf4b3-8eed-4733-8917-249ee4032f91 req-c916b718-fad5-42a4-a8d0-da344a83ac90 service nova] Creating event network-changed:99bf6922-c8df-418b-91be-5f5d1aeea287 for instance cee14a35-0425-48c3-9e4e-efed2fdd23a1 on hv-cinder-84599 Aug 02 09:15:17.622185 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-aacdf4b3-8eed-4733-8917-249ee4032f91 req-c916b718-fad5-42a4-a8d0-da344a83ac90 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034813 Aug 02 09:15:17.622932 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 274/539] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:17.924687 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-16f2be7d-e131-4d1d-808e-82af7016ced7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:17.926005 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-16f2be7d-e131-4d1d-808e-82af7016ced7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:17.932934 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-16f2be7d-e131-4d1d-808e-82af7016ced7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:17.933486 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-16f2be7d-e131-4d1d-808e-82af7016ced7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:17.934359 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-16f2be7d-e131-4d1d-808e-82af7016ced7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:17.935031 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-16f2be7d-e131-4d1d-808e-82af7016ced7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:17.988950 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-95b31ce5-f72a-475c-bb64-14d1ed8f1ca5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:17.989943 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-95b31ce5-f72a-475c-bb64-14d1ed8f1ca5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:17.999712 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-95b31ce5-f72a-475c-bb64-14d1ed8f1ca5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:17.999712 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-95b31ce5-f72a-475c-bb64-14d1ed8f1ca5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:18.001129 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-95b31ce5-f72a-475c-bb64-14d1ed8f1ca5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:18.001736 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-95b31ce5-f72a-475c-bb64-14d1ed8f1ca5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:18.187634 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-16f2be7d-e131-4d1d-808e-82af7016ced7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:18.203121 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-16f2be7d-e131-4d1d-808e-82af7016ced7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1674 microversion: 2.1 time: 0.284262 Aug 02 09:15:18.205388 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 266/540] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:17 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1674 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:18.214265 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-fa0c293c-90ff-4b6b-8f64-098f4bbf86be tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:18.215526 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-fa0c293c-90ff-4b6b-8f64-098f4bbf86be tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:18.227162 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fa0c293c-90ff-4b6b-8f64-098f4bbf86be tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:18.228187 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fa0c293c-90ff-4b6b-8f64-098f4bbf86be tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:18.229757 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fa0c293c-90ff-4b6b-8f64-098f4bbf86be tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:18.230634 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fa0c293c-90ff-4b6b-8f64-098f4bbf86be tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:18.481167 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-95b31ce5-f72a-475c-bb64-14d1ed8f1ca5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:18.492047 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-95b31ce5-f72a-475c-bb64-14d1ed8f1ca5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:18.493861 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-95b31ce5-f72a-475c-bb64-14d1ed8f1ca5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:18.494792 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-95b31ce5-f72a-475c-bb64-14d1ed8f1ca5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1407 microversion: 2.20 time: 0.510678 Aug 02 09:15:18.495368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 275/541] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:15:17 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1407 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:15:18.543051 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-fa0c293c-90ff-4b6b-8f64-098f4bbf86be tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:18.551404 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-fa0c293c-90ff-4b6b-8f64-098f4bbf86be tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 200 len: 1267 microversion: 2.1 time: 0.345533 Aug 02 09:15:18.551976 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 267/542] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:18 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 1267 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:19.226982 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-a13867c2-bed0-4ff2-9ea7-9baf7d53d566 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:19.227736 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-a13867c2-bed0-4ff2-9ea7-9baf7d53d566 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:19.235264 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a13867c2-bed0-4ff2-9ea7-9baf7d53d566 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:19.235717 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a13867c2-bed0-4ff2-9ea7-9baf7d53d566 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:19.236547 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a13867c2-bed0-4ff2-9ea7-9baf7d53d566 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:19.236982 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a13867c2-bed0-4ff2-9ea7-9baf7d53d566 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:19.380877 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-a13867c2-bed0-4ff2-9ea7-9baf7d53d566 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:19.392833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-a13867c2-bed0-4ff2-9ea7-9baf7d53d566 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1674 microversion: 2.1 time: 0.169592 Aug 02 09:15:19.393486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 276/543] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:19 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1674 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:19.467042 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-58e6dd01-cda9-4674-a3a5-7d4ac3771b41 req-df3175ac-0c76-48cc-b971-0ace0ac7fd88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b54fded6-ca19-48e6-b971-31f061cce0c5", "name": "network-vif-plugged", "status": "completed", "tag": "021d8483-0afc-44b7-b117-6f61fcf5696d"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:19.478244 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-58e6dd01-cda9-4674-a3a5-7d4ac3771b41 req-df3175ac-0c76-48cc-b971-0ace0ac7fd88 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:19.478697 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-58e6dd01-cda9-4674-a3a5-7d4ac3771b41 req-df3175ac-0c76-48cc-b971-0ace0ac7fd88 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:19.491988 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-58e6dd01-cda9-4674-a3a5-7d4ac3771b41 req-df3175ac-0c76-48cc-b971-0ace0ac7fd88 service nova] Creating event network-vif-plugged:021d8483-0afc-44b7-b117-6f61fcf5696d for instance b54fded6-ca19-48e6-b971-31f061cce0c5 on hv-cinder-84599 Aug 02 09:15:19.497294 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-58e6dd01-cda9-4674-a3a5-7d4ac3771b41 req-df3175ac-0c76-48cc-b971-0ace0ac7fd88 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033959 Aug 02 09:15:19.499355 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 268/544] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:19.519319 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-954bd656-ffea-4b4d-8681-4652ba45778a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:19.519916 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-954bd656-ffea-4b4d-8681-4652ba45778a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:19.526343 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-954bd656-ffea-4b4d-8681-4652ba45778a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:19.526779 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-954bd656-ffea-4b4d-8681-4652ba45778a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:19.527552 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-954bd656-ffea-4b4d-8681-4652ba45778a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:19.527981 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-954bd656-ffea-4b4d-8681-4652ba45778a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:19.574383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-d85cee16-eba1-4211-af21-30e65c4863dd tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:19.575017 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-d85cee16-eba1-4211-af21-30e65c4863dd tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:19.587625 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d85cee16-eba1-4211-af21-30e65c4863dd tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:19.588440 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d85cee16-eba1-4211-af21-30e65c4863dd tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:19.589878 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d85cee16-eba1-4211-af21-30e65c4863dd tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:19.591831 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d85cee16-eba1-4211-af21-30e65c4863dd tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:19.759310 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-954bd656-ffea-4b4d-8681-4652ba45778a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:19.770087 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-954bd656-ffea-4b4d-8681-4652ba45778a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:19.771803 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-954bd656-ffea-4b4d-8681-4652ba45778a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:19.773628 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-954bd656-ffea-4b4d-8681-4652ba45778a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1407 microversion: 2.20 time: 0.258634 Aug 02 09:15:19.774050 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 277/545] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:15:19 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:15:19.795433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-d85cee16-eba1-4211-af21-30e65c4863dd tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:19.803953 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-d85cee16-eba1-4211-af21-30e65c4863dd tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 200 len: 1267 microversion: 2.1 time: 0.233790 Aug 02 09:15:19.804588 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 269/546] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:19 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:20.415840 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-f42b0687-e854-4cf3-9087-fb5a0fcba9ed tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:20.416856 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-f42b0687-e854-4cf3-9087-fb5a0fcba9ed tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:20.418980 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=4 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:20.425617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f42b0687-e854-4cf3-9087-fb5a0fcba9ed tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:20.426069 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f42b0687-e854-4cf3-9087-fb5a0fcba9ed tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:20.426858 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f42b0687-e854-4cf3-9087-fb5a0fcba9ed tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:20.427294 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f42b0687-e854-4cf3-9087-fb5a0fcba9ed tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:20.574453 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-f42b0687-e854-4cf3-9087-fb5a0fcba9ed tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:20.584137 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-f42b0687-e854-4cf3-9087-fb5a0fcba9ed tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1674 microversion: 2.1 time: 0.172472 Aug 02 09:15:20.584803 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 278/547] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:20 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:20.803185 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-902aa7e3-ac4e-4dcf-8ae6-fbce4770f87b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:20.803861 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-902aa7e3-ac4e-4dcf-8ae6-fbce4770f87b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:20.811876 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-902aa7e3-ac4e-4dcf-8ae6-fbce4770f87b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:20.812369 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-902aa7e3-ac4e-4dcf-8ae6-fbce4770f87b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:20.813178 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-902aa7e3-ac4e-4dcf-8ae6-fbce4770f87b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:20.813604 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-902aa7e3-ac4e-4dcf-8ae6-fbce4770f87b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:20.845007 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-99f87a4b-e32d-4f6b-b390-7919ae2e7d99 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:20.845954 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-99f87a4b-e32d-4f6b-b390-7919ae2e7d99 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:20.853051 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-99f87a4b-e32d-4f6b-b390-7919ae2e7d99 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:20.853592 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-99f87a4b-e32d-4f6b-b390-7919ae2e7d99 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:20.854604 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-99f87a4b-e32d-4f6b-b390-7919ae2e7d99 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:20.855047 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-99f87a4b-e32d-4f6b-b390-7919ae2e7d99 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:21.053730 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-902aa7e3-ac4e-4dcf-8ae6-fbce4770f87b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:21.063542 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-902aa7e3-ac4e-4dcf-8ae6-fbce4770f87b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:21.065252 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-902aa7e3-ac4e-4dcf-8ae6-fbce4770f87b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:21.070253 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-902aa7e3-ac4e-4dcf-8ae6-fbce4770f87b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1407 microversion: 2.20 time: 0.267203 Aug 02 09:15:21.070253 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 270/548] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:15:20 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:15:21.090182 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-99f87a4b-e32d-4f6b-b390-7919ae2e7d99 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:21.098749 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-99f87a4b-e32d-4f6b-b390-7919ae2e7d99 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 200 len: 1267 microversion: 2.1 time: 0.259828 Aug 02 09:15:21.099272 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 279/549] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:20 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 1267 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:21.609280 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-3860de4b-a962-4714-9349-1dd707a90b85 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:21.610144 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-3860de4b-a962-4714-9349-1dd707a90b85 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:21.619261 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3860de4b-a962-4714-9349-1dd707a90b85 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:21.619897 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3860de4b-a962-4714-9349-1dd707a90b85 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:21.620825 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3860de4b-a962-4714-9349-1dd707a90b85 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:21.621258 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3860de4b-a962-4714-9349-1dd707a90b85 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:21.830117 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-3860de4b-a962-4714-9349-1dd707a90b85 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:21.838741 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-3860de4b-a962-4714-9349-1dd707a90b85 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1651 microversion: 2.1 time: 0.235339 Aug 02 09:15:21.839507 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 271/550] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:21 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1651 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:21.869048 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-b54b01d9-2eb3-4805-bd1d-d377ffc3156b tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:21.869048 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=14 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:21.875579 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b54b01d9-2eb3-4805-bd1d-d377ffc3156b tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:21.876031 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b54b01d9-2eb3-4805-bd1d-d377ffc3156b tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:21.942814 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-b54b01d9-2eb3-4805-bd1d-d377ffc3156b tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Going to try to start instance {{(pid=118525) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 02 09:15:22.091308 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b147f8a0-e414-4ecc-8749-0782c256d3b8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:22.091921 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b147f8a0-e414-4ecc-8749-0782c256d3b8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:22.099945 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b147f8a0-e414-4ecc-8749-0782c256d3b8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:22.100591 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b147f8a0-e414-4ecc-8749-0782c256d3b8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:22.101354 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b147f8a0-e414-4ecc-8749-0782c256d3b8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:22.101793 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b147f8a0-e414-4ecc-8749-0782c256d3b8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:22.194392 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-b54b01d9-2eb3-4805-bd1d-d377ffc3156b tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "POST /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb/action" status: 202 len: 0 microversion: 2.1 time: 0.334836 Aug 02 09:15:22.195016 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 280/551] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 2 09:15:21 2022] POST /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:15:22.201284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-b05a4542-0b52-4120-b8fa-2e65eb141ce3 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:22.202243 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-b05a4542-0b52-4120-b8fa-2e65eb141ce3 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:22.210160 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b05a4542-0b52-4120-b8fa-2e65eb141ce3 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:22.210627 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b05a4542-0b52-4120-b8fa-2e65eb141ce3 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:22.211453 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b05a4542-0b52-4120-b8fa-2e65eb141ce3 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:22.211895 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b05a4542-0b52-4120-b8fa-2e65eb141ce3 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:22.317346 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b147f8a0-e414-4ecc-8749-0782c256d3b8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:22.321639 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:22.334019 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b147f8a0-e414-4ecc-8749-0782c256d3b8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:22.337335 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b147f8a0-e414-4ecc-8749-0782c256d3b8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:22.339556 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b147f8a0-e414-4ecc-8749-0782c256d3b8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1598 microversion: 2.20 time: 0.252059 Aug 02 09:15:22.340600 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 272/552] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:15:22 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1598 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:15:22.348106 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-acb0d2a6-6a63-49b6-a439-5172b98ac1dc tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:22.349807 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-acb0d2a6-6a63-49b6-a439-5172b98ac1dc tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:22.356080 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-acb0d2a6-6a63-49b6-a439-5172b98ac1dc tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:22.356642 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-acb0d2a6-6a63-49b6-a439-5172b98ac1dc tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:22.357402 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-acb0d2a6-6a63-49b6-a439-5172b98ac1dc tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:22.357919 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-acb0d2a6-6a63-49b6-a439-5172b98ac1dc tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:22.420667 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-b05a4542-0b52-4120-b8fa-2e65eb141ce3 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:22.429626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-b05a4542-0b52-4120-b8fa-2e65eb141ce3 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 200 len: 1267 microversion: 2.1 time: 0.233367 Aug 02 09:15:22.430215 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 281/553] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:22 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:22.435200 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-9d56e009-2dcf-4ba4-a6dd-ce7c2d777b93 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:22.435847 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-9d56e009-2dcf-4ba4-a6dd-ce7c2d777b93 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:22.442774 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9d56e009-2dcf-4ba4-a6dd-ce7c2d777b93 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:22.445085 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9d56e009-2dcf-4ba4-a6dd-ce7c2d777b93 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:22.445085 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9d56e009-2dcf-4ba4-a6dd-ce7c2d777b93 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:22.445085 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9d56e009-2dcf-4ba4-a6dd-ce7c2d777b93 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:22.620550 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-9d56e009-2dcf-4ba4-a6dd-ce7c2d777b93 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.188823 Aug 02 09:15:22.621601 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 282/554] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Aug 2 09:15:22 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:15:22.660002 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-acb0d2a6-6a63-49b6-a439-5172b98ac1dc tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:22.671898 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-acb0d2a6-6a63-49b6-a439-5172b98ac1dc tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1660 microversion: 2.1 time: 0.329190 Aug 02 09:15:22.672895 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 273/555] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:22 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1660 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:23.455010 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-73fd9086-78d4-4de2-9f85-a40f7152cf71 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:23.455707 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-73fd9086-78d4-4de2-9f85-a40f7152cf71 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:23.462252 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-73fd9086-78d4-4de2-9f85-a40f7152cf71 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:23.462718 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-73fd9086-78d4-4de2-9f85-a40f7152cf71 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:23.463618 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-73fd9086-78d4-4de2-9f85-a40f7152cf71 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:23.463914 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-73fd9086-78d4-4de2-9f85-a40f7152cf71 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:23.629662 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-73fd9086-78d4-4de2-9f85-a40f7152cf71 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:23.638186 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-73fd9086-78d4-4de2-9f85-a40f7152cf71 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 200 len: 1267 microversion: 2.1 time: 0.187981 Aug 02 09:15:23.638772 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 283/556] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:23 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:23.694727 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-9d396317-0695-470a-ad1a-296052a6b7e4 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:23.695381 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-9d396317-0695-470a-ad1a-296052a6b7e4 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:23.703807 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9d396317-0695-470a-ad1a-296052a6b7e4 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:23.704299 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9d396317-0695-470a-ad1a-296052a6b7e4 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:23.705090 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9d396317-0695-470a-ad1a-296052a6b7e4 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:23.705519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9d396317-0695-470a-ad1a-296052a6b7e4 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:23.841359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-626f5f40-b0bb-480e-9f63-3eefa6f06d81 req-e6365384-00d7-4152-ac68-a03a3371c321 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b54fded6-ca19-48e6-b971-31f061cce0c5", "tag": "021d8483-0afc-44b7-b117-6f61fcf5696d"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:23.852058 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-626f5f40-b0bb-480e-9f63-3eefa6f06d81 req-e6365384-00d7-4152-ac68-a03a3371c321 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:23.852698 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-626f5f40-b0bb-480e-9f63-3eefa6f06d81 req-e6365384-00d7-4152-ac68-a03a3371c321 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:23.866734 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-626f5f40-b0bb-480e-9f63-3eefa6f06d81 req-e6365384-00d7-4152-ac68-a03a3371c321 service nova] Creating event network-changed:021d8483-0afc-44b7-b117-6f61fcf5696d for instance b54fded6-ca19-48e6-b971-31f061cce0c5 on hv-cinder-84599 Aug 02 09:15:23.872315 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-626f5f40-b0bb-480e-9f63-3eefa6f06d81 req-e6365384-00d7-4152-ac68-a03a3371c321 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034509 Aug 02 09:15:23.873080 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 284/557] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:15:23.901281 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-9d396317-0695-470a-ad1a-296052a6b7e4 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:23.910267 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-9d396317-0695-470a-ad1a-296052a6b7e4 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1660 microversion: 2.1 time: 0.219767 Aug 02 09:15:23.910857 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 274/558] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:23 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1660 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:24.672843 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-0187dcda-0909-454a-ad42-9d925af901e5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:24.673559 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-0187dcda-0909-454a-ad42-9d925af901e5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:24.680927 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0187dcda-0909-454a-ad42-9d925af901e5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:24.681391 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0187dcda-0909-454a-ad42-9d925af901e5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:24.682065 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0187dcda-0909-454a-ad42-9d925af901e5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:24.682498 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0187dcda-0909-454a-ad42-9d925af901e5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:24.875197 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-0187dcda-0909-454a-ad42-9d925af901e5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:24.887653 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-0187dcda-0909-454a-ad42-9d925af901e5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 200 len: 1267 microversion: 2.1 time: 0.220668 Aug 02 09:15:24.888680 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 285/559] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:24 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:24.937298 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-f87e6376-ecdd-4b97-babc-8d4aceb77445 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:24.938035 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-f87e6376-ecdd-4b97-babc-8d4aceb77445 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:24.946303 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f87e6376-ecdd-4b97-babc-8d4aceb77445 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:24.947096 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f87e6376-ecdd-4b97-babc-8d4aceb77445 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:24.948611 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f87e6376-ecdd-4b97-babc-8d4aceb77445 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:24.949368 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f87e6376-ecdd-4b97-babc-8d4aceb77445 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:25.126538 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-f87e6376-ecdd-4b97-babc-8d4aceb77445 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:25.134370 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-f87e6376-ecdd-4b97-babc-8d4aceb77445 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1664 microversion: 2.1 time: 0.203020 Aug 02 09:15:25.134946 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 275/560] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:24 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1664 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:25.911849 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-f3ab1a1f-1076-415f-8272-9fcf661154b8 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:25.912503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-f3ab1a1f-1076-415f-8272-9fcf661154b8 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:25.927912 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f3ab1a1f-1076-415f-8272-9fcf661154b8 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:25.928553 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f3ab1a1f-1076-415f-8272-9fcf661154b8 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:25.929363 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f3ab1a1f-1076-415f-8272-9fcf661154b8 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:25.929829 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f3ab1a1f-1076-415f-8272-9fcf661154b8 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:26.138200 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-f3ab1a1f-1076-415f-8272-9fcf661154b8 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:26.148451 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-f3ab1a1f-1076-415f-8272-9fcf661154b8 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 200 len: 1267 microversion: 2.1 time: 0.240002 Aug 02 09:15:26.148672 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 286/561] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:25 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 1267 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:27.170763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-f2ef18aa-afb5-47d3-a796-d2c55b36c170 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:27.172072 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-f2ef18aa-afb5-47d3-a796-d2c55b36c170 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:27.179102 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f2ef18aa-afb5-47d3-a796-d2c55b36c170 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:27.179609 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f2ef18aa-afb5-47d3-a796-d2c55b36c170 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:27.180425 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f2ef18aa-afb5-47d3-a796-d2c55b36c170 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:27.180866 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f2ef18aa-afb5-47d3-a796-d2c55b36c170 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:27.343389 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-f2ef18aa-afb5-47d3-a796-d2c55b36c170 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:27.354731 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-f2ef18aa-afb5-47d3-a796-d2c55b36c170 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 200 len: 1267 microversion: 2.1 time: 0.187984 Aug 02 09:15:27.355324 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 276/562] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:27 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:28.377529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-09e3b33b-39bf-4605-9a2f-a2e453d0a7bf tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:28.378148 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-09e3b33b-39bf-4605-9a2f-a2e453d0a7bf tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:28.385951 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-09e3b33b-39bf-4605-9a2f-a2e453d0a7bf tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:28.386737 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-09e3b33b-39bf-4605-9a2f-a2e453d0a7bf tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:28.388368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-09e3b33b-39bf-4605-9a2f-a2e453d0a7bf tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:28.389311 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-09e3b33b-39bf-4605-9a2f-a2e453d0a7bf tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:28.538053 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-09e3b33b-39bf-4605-9a2f-a2e453d0a7bf tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:28.545918 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-09e3b33b-39bf-4605-9a2f-a2e453d0a7bf tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 200 len: 1267 microversion: 2.1 time: 0.173821 Aug 02 09:15:28.547440 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 287/563] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:28 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:29.541407 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-ca555237-7f43-4c91-a8ab-03719a0ec4ff req-ff7b86f7-49da-43cb-a5f5-02d2e9d69a24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cee14a35-0425-48c3-9e4e-efed2fdd23a1", "name": "network-vif-plugged", "status": "completed", "tag": "99bf6922-c8df-418b-91be-5f5d1aeea287"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:29.548130 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:29.554723 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-ca555237-7f43-4c91-a8ab-03719a0ec4ff req-ff7b86f7-49da-43cb-a5f5-02d2e9d69a24 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:29.555222 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-ca555237-7f43-4c91-a8ab-03719a0ec4ff req-ff7b86f7-49da-43cb-a5f5-02d2e9d69a24 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:29.569742 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-69dd486b-05e7-48ef-8018-0d89775a7038 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:29.570356 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-ca555237-7f43-4c91-a8ab-03719a0ec4ff req-ff7b86f7-49da-43cb-a5f5-02d2e9d69a24 service nova] Creating event network-vif-plugged:99bf6922-c8df-418b-91be-5f5d1aeea287 for instance cee14a35-0425-48c3-9e4e-efed2fdd23a1 on hv-cinder-84599 Aug 02 09:15:29.570476 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-69dd486b-05e7-48ef-8018-0d89775a7038 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:29.577014 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-ca555237-7f43-4c91-a8ab-03719a0ec4ff req-ff7b86f7-49da-43cb-a5f5-02d2e9d69a24 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039356 Aug 02 09:15:29.578271 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 277/564] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:15:29.580556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-69dd486b-05e7-48ef-8018-0d89775a7038 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:29.581089 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-69dd486b-05e7-48ef-8018-0d89775a7038 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:29.581812 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-69dd486b-05e7-48ef-8018-0d89775a7038 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:29.582245 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-69dd486b-05e7-48ef-8018-0d89775a7038 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:29.758053 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-69dd486b-05e7-48ef-8018-0d89775a7038 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:29.767422 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-69dd486b-05e7-48ef-8018-0d89775a7038 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 200 len: 1267 microversion: 2.1 time: 0.202580 Aug 02 09:15:29.768024 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 288/565] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:29 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 1267 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:30.791483 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-ba82be0d-af0c-4b8d-a2e3-d3738d2712e9 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:30.792314 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-ba82be0d-af0c-4b8d-a2e3-d3738d2712e9 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:30.804860 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ba82be0d-af0c-4b8d-a2e3-d3738d2712e9 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:30.807738 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ba82be0d-af0c-4b8d-a2e3-d3738d2712e9 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:30.807738 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ba82be0d-af0c-4b8d-a2e3-d3738d2712e9 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:30.808212 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ba82be0d-af0c-4b8d-a2e3-d3738d2712e9 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:30.980149 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-ba82be0d-af0c-4b8d-a2e3-d3738d2712e9 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:30.990182 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-ba82be0d-af0c-4b8d-a2e3-d3738d2712e9 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 200 len: 1267 microversion: 2.1 time: 0.203985 Aug 02 09:15:30.990781 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 278/566] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:30 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 1267 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:32.014076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-a9428219-a12a-49b8-bece-7b54296d5b7a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:32.014631 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-a9428219-a12a-49b8-bece-7b54296d5b7a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:32.022064 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a9428219-a12a-49b8-bece-7b54296d5b7a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:32.022513 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a9428219-a12a-49b8-bece-7b54296d5b7a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:32.023337 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a9428219-a12a-49b8-bece-7b54296d5b7a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:32.023773 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a9428219-a12a-49b8-bece-7b54296d5b7a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:32.199054 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-a9428219-a12a-49b8-bece-7b54296d5b7a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:32.208904 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-a9428219-a12a-49b8-bece-7b54296d5b7a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 200 len: 1267 microversion: 2.1 time: 0.198495 Aug 02 09:15:32.209583 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 289/567] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:32 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 1267 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:33.243787 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-d1f9e5c8-d438-44a7-adeb-3be8d785e022 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:33.244913 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-d1f9e5c8-d438-44a7-adeb-3be8d785e022 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:33.256787 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d1f9e5c8-d438-44a7-adeb-3be8d785e022 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:33.257484 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d1f9e5c8-d438-44a7-adeb-3be8d785e022 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:33.259097 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d1f9e5c8-d438-44a7-adeb-3be8d785e022 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:33.259896 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d1f9e5c8-d438-44a7-adeb-3be8d785e022 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:33.423257 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-d1f9e5c8-d438-44a7-adeb-3be8d785e022 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:33.431152 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-d1f9e5c8-d438-44a7-adeb-3be8d785e022 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 200 len: 1455 microversion: 2.1 time: 0.193999 Aug 02 09:15:33.431771 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 279/568] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:33 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 1455 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:33.454746 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-14ae604d-91fb-4c6d-aba5-9f97a63c1c2f tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:33.455357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-14ae604d-91fb-4c6d-aba5-9f97a63c1c2f tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:33.462288 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-14ae604d-91fb-4c6d-aba5-9f97a63c1c2f tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:33.462767 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-14ae604d-91fb-4c6d-aba5-9f97a63c1c2f tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:33.463634 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-14ae604d-91fb-4c6d-aba5-9f97a63c1c2f tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:33.463984 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-14ae604d-91fb-4c6d-aba5-9f97a63c1c2f tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:33.626776 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-14ae604d-91fb-4c6d-aba5-9f97a63c1c2f tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:33.636931 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-14ae604d-91fb-4c6d-aba5-9f97a63c1c2f tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 200 len: 1455 microversion: 2.1 time: 0.186720 Aug 02 09:15:33.637536 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 290/569] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:33 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 1455 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:36.692240 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-8947c5f9-420b-44c8-9473-512f25d7bf2f req-d00153b1-5552-4633-898c-bd90a246ad7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cee14a35-0425-48c3-9e4e-efed2fdd23a1", "tag": "99bf6922-c8df-418b-91be-5f5d1aeea287"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:36.707176 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-8947c5f9-420b-44c8-9473-512f25d7bf2f req-d00153b1-5552-4633-898c-bd90a246ad7b service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:36.708743 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-8947c5f9-420b-44c8-9473-512f25d7bf2f req-d00153b1-5552-4633-898c-bd90a246ad7b service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:36.725236 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-8947c5f9-420b-44c8-9473-512f25d7bf2f req-d00153b1-5552-4633-898c-bd90a246ad7b service nova] Creating event network-changed:99bf6922-c8df-418b-91be-5f5d1aeea287 for instance cee14a35-0425-48c3-9e4e-efed2fdd23a1 on hv-cinder-84599 Aug 02 09:15:36.737447 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-8947c5f9-420b-44c8-9473-512f25d7bf2f req-d00153b1-5552-4633-898c-bd90a246ad7b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048158 Aug 02 09:15:36.737447 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 280/570] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:15:41.015043 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-f5c06209-798c-4b60-aaeb-de2e5253cf89 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:41.015745 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-f5c06209-798c-4b60-aaeb-de2e5253cf89 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:41.022560 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f5c06209-798c-4b60-aaeb-de2e5253cf89 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:41.023015 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f5c06209-798c-4b60-aaeb-de2e5253cf89 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:41.023797 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f5c06209-798c-4b60-aaeb-de2e5253cf89 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:41.024263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f5c06209-798c-4b60-aaeb-de2e5253cf89 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:41.027106 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:41.112548 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.objects.instance [None req-f5c06209-798c-4b60-aaeb-de2e5253cf89 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lazy-loading 'services' on Instance uuid 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d {{(pid=118525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:15:41.499227 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-f5c06209-798c-4b60-aaeb-de2e5253cf89 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "DELETE /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d/os-volume_attachments/83808ea6-072c-432e-8823-374952b9e43d" status: 202 len: 0 microversion: 2.1 time: 0.487910 Aug 02 09:15:41.499967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 291/571] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 2 09:15:41 2022] DELETE /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d/os-volume_attachments/83808ea6-072c-432e-8823-374952b9e43d => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:15:41.510299 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-3cd2d669-c3a5-4738-995d-a0e4c329dacc tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:41.513799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-3cd2d669-c3a5-4738-995d-a0e4c329dacc tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:41.523001 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3cd2d669-c3a5-4738-995d-a0e4c329dacc tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:41.523592 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3cd2d669-c3a5-4738-995d-a0e4c329dacc tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:41.524532 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3cd2d669-c3a5-4738-995d-a0e4c329dacc tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:41.525020 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3cd2d669-c3a5-4738-995d-a0e4c329dacc tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:41.562910 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-3cd2d669-c3a5-4738-995d-a0e4c329dacc tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057151 Aug 02 09:15:41.563417 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 281/572] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:15:41 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:42.582529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ba1e0e20-59f8-43fb-94a6-eb960f6dc623 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:42.586475 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ba1e0e20-59f8-43fb-94a6-eb960f6dc623 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:42.599685 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ba1e0e20-59f8-43fb-94a6-eb960f6dc623 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:42.600477 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ba1e0e20-59f8-43fb-94a6-eb960f6dc623 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:42.602563 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ba1e0e20-59f8-43fb-94a6-eb960f6dc623 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:42.602728 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ba1e0e20-59f8-43fb-94a6-eb960f6dc623 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:42.661901 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ba1e0e20-59f8-43fb-94a6-eb960f6dc623 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.089302 Aug 02 09:15:42.678513 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 292/573] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:15:42 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:43.681881 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-67926d0b-7b8f-412a-a00c-1ba46dc32073 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:43.684079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-67926d0b-7b8f-412a-a00c-1ba46dc32073 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:43.691791 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-67926d0b-7b8f-412a-a00c-1ba46dc32073 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:43.692304 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-67926d0b-7b8f-412a-a00c-1ba46dc32073 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:43.693182 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-67926d0b-7b8f-412a-a00c-1ba46dc32073 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:43.693667 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-67926d0b-7b8f-412a-a00c-1ba46dc32073 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:43.741619 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-67926d0b-7b8f-412a-a00c-1ba46dc32073 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064248 Aug 02 09:15:43.746161 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 282/574] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:15:43 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:15:43.848508 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-bb56f58c-eb01-40d3-bb50-a37b62ac12ef tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:43.849365 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-bb56f58c-eb01-40d3-bb50-a37b62ac12ef tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:43.851646 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=54 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:43.857506 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bb56f58c-eb01-40d3-bb50-a37b62ac12ef tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:43.858008 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bb56f58c-eb01-40d3-bb50-a37b62ac12ef tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:43.859539 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bb56f58c-eb01-40d3-bb50-a37b62ac12ef tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:43.860023 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bb56f58c-eb01-40d3-bb50-a37b62ac12ef tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:43.895083 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-bb56f58c-eb01-40d3-bb50-a37b62ac12ef tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Going to try to terminate instance {{(pid=118525) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:15:44.282377 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-bb56f58c-eb01-40d3-bb50-a37b62ac12ef tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "DELETE /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 204 len: 0 microversion: 2.1 time: 0.437467 Aug 02 09:15:44.290760 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 293/575] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:15:43 2022] DELETE /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 09:15:44.291907 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-7a89c388-0fdf-455b-8ac0-4c4229094e0f tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:44.292564 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-7a89c388-0fdf-455b-8ac0-4c4229094e0f tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:44.299757 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7a89c388-0fdf-455b-8ac0-4c4229094e0f tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:44.300260 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7a89c388-0fdf-455b-8ac0-4c4229094e0f tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:44.301066 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7a89c388-0fdf-455b-8ac0-4c4229094e0f tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:44.301505 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7a89c388-0fdf-455b-8ac0-4c4229094e0f tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:44.474266 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-7a89c388-0fdf-455b-8ac0-4c4229094e0f tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:44.484966 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-7a89c388-0fdf-455b-8ac0-4c4229094e0f tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1689 microversion: 2.1 time: 0.196997 Aug 02 09:15:44.485750 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 283/576] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:44 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1689 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:45.584718 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-8d768ee5-d654-4387-8e9b-af62e0e69aba tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:45.585497 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-8d768ee5-d654-4387-8e9b-af62e0e69aba tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:45.592201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8d768ee5-d654-4387-8e9b-af62e0e69aba tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:45.593156 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8d768ee5-d654-4387-8e9b-af62e0e69aba tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:45.593963 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8d768ee5-d654-4387-8e9b-af62e0e69aba tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:45.594495 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8d768ee5-d654-4387-8e9b-af62e0e69aba tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:45.776397 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-8d768ee5-d654-4387-8e9b-af62e0e69aba tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:45.785452 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-8d768ee5-d654-4387-8e9b-af62e0e69aba tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1689 microversion: 2.1 time: 0.282109 Aug 02 09:15:45.786029 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 294/577] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:45 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1689 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:46.810824 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c044ba9b-9b7d-4775-937f-bdd496428047 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:46.811517 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-c044ba9b-9b7d-4775-937f-bdd496428047 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:46.818636 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c044ba9b-9b7d-4775-937f-bdd496428047 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:46.819092 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c044ba9b-9b7d-4775-937f-bdd496428047 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:46.819922 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c044ba9b-9b7d-4775-937f-bdd496428047 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:46.820424 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c044ba9b-9b7d-4775-937f-bdd496428047 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:46.966962 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-c044ba9b-9b7d-4775-937f-bdd496428047 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:46.975432 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-c044ba9b-9b7d-4775-937f-bdd496428047 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1689 microversion: 2.1 time: 0.168715 Aug 02 09:15:46.976006 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 284/578] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:46 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:48.000017 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-89545e09-5f7e-41cf-b583-7b05c06bbcf5 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:48.001036 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-89545e09-5f7e-41cf-b583-7b05c06bbcf5 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:48.007834 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-89545e09-5f7e-41cf-b583-7b05c06bbcf5 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:48.008333 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-89545e09-5f7e-41cf-b583-7b05c06bbcf5 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:48.009121 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-89545e09-5f7e-41cf-b583-7b05c06bbcf5 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:48.009562 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-89545e09-5f7e-41cf-b583-7b05c06bbcf5 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:48.149402 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-89545e09-5f7e-41cf-b583-7b05c06bbcf5 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:48.159040 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-89545e09-5f7e-41cf-b583-7b05c06bbcf5 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1689 microversion: 2.1 time: 0.164922 Aug 02 09:15:48.159460 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 295/579] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:47 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:49.179330 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-8477cdce-d7d4-4330-8c79-f993d08f0760 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:49.180042 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-8477cdce-d7d4-4330-8c79-f993d08f0760 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:49.187714 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-8477cdce-d7d4-4330-8c79-f993d08f0760 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:49.188155 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-8477cdce-d7d4-4330-8c79-f993d08f0760 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:49.188946 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-8477cdce-d7d4-4330-8c79-f993d08f0760 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:49.189380 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-8477cdce-d7d4-4330-8c79-f993d08f0760 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:49.435324 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-8477cdce-d7d4-4330-8c79-f993d08f0760 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:49.445424 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-8477cdce-d7d4-4330-8c79-f993d08f0760 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1689 microversion: 2.1 time: 0.270335 Aug 02 09:15:49.446254 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 285/580] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:49 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1689 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:49.990718 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-e0f5aadc-cb71-4b04-a7c8-6a9588a85258 req-1cf51c01-828c-4e28-8c54-36b66ee7259e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "351f0943-3d4a-43c0-a57d-2e0bdda1fc4d", "name": "network-vif-deleted", "tag": "7fd2e01d-97ab-4034-89c5-5069ee9e9915"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:50.006296 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-e0f5aadc-cb71-4b04-a7c8-6a9588a85258 req-1cf51c01-828c-4e28-8c54-36b66ee7259e service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:50.006835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-e0f5aadc-cb71-4b04-a7c8-6a9588a85258 req-1cf51c01-828c-4e28-8c54-36b66ee7259e service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:50.020701 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-e0f5aadc-cb71-4b04-a7c8-6a9588a85258 req-1cf51c01-828c-4e28-8c54-36b66ee7259e service nova] Creating event network-vif-deleted:7fd2e01d-97ab-4034-89c5-5069ee9e9915 for instance 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d on hv-cinder-84599 Aug 02 09:15:50.026555 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-e0f5aadc-cb71-4b04-a7c8-6a9588a85258 req-1cf51c01-828c-4e28-8c54-36b66ee7259e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040457 Aug 02 09:15:50.027923 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 296/581] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:50.467763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-dd63a855-f741-4c4f-af0f-470b67edb718 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:50.468969 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-dd63a855-f741-4c4f-af0f-470b67edb718 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:50.475615 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-dd63a855-f741-4c4f-af0f-470b67edb718 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:50.476067 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-dd63a855-f741-4c4f-af0f-470b67edb718 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:50.476881 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-dd63a855-f741-4c4f-af0f-470b67edb718 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:50.477321 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-dd63a855-f741-4c4f-af0f-470b67edb718 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:50.514329 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-dd63a855-f741-4c4f-af0f-470b67edb718 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:50.515286 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-dd63a855-f741-4c4f-af0f-470b67edb718 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:50.515685 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.objects.instance [None req-dd63a855-f741-4c4f-af0f-470b67edb718 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lazy-loading 'fault' on Instance uuid 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d {{(pid=118526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:15:50.564426 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-dd63a855-f741-4c4f-af0f-470b67edb718 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:50.577466 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-dd63a855-f741-4c4f-af0f-470b67edb718 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 200 len: 1335 microversion: 2.1 time: 0.113784 Aug 02 09:15:50.584707 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 286/582] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:50 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 1335 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:51.614121 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-84176ca0-6fa4-4c16-a285-bdd0fed6be63 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:51.614837 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-84176ca0-6fa4-4c16-a285-bdd0fed6be63 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:51.622200 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-84176ca0-6fa4-4c16-a285-bdd0fed6be63 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:51.622643 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-84176ca0-6fa4-4c16-a285-bdd0fed6be63 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:51.623431 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-84176ca0-6fa4-4c16-a285-bdd0fed6be63 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:51.624603 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-84176ca0-6fa4-4c16-a285-bdd0fed6be63 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:51.641764 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-84176ca0-6fa4-4c16-a285-bdd0fed6be63 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] HTTP exception thrown: Instance 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d could not be found. Aug 02 09:15:51.650181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-84176ca0-6fa4-4c16-a285-bdd0fed6be63 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Request method failure captured: Aug 02 09:15:51.650181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d HTTP/1.1 Aug 02 09:15:51.650181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:15:51.650181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:15:51.650181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:15:51.650181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:15:51.650181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:15:51.650181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:15:51.650181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:15:51.650181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:15:51.650181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6OoRmwjoNYhYnEcpgvvMEgd2xKWzF42xFe2mQGMLj3xIf2rbW7jLb_M6K5s8XRrNt0jgV2BkoLp__0sW_xWvmzuZaSam16BGZbPOtbFV1QdDLxB4qZlviKTAjvfQC9uvL31nkGmI2TvBy6_wRRQkKYA6ErGyVZGDEB2BoL_ZMmAWEOk Aug 02 09:15:51.650181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:15:51.650181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:15:51.650181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:15:51.650181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:15:51.650181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:15:51.650181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:15:51.650181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: 5b01727cea94442bb62b56e7a4ae57a0 Aug 02 09:15:51.650181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1040473499 Aug 02 09:15:51.650181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:15:51.650181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:15:51.651789 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b01727cea94442bb62b56e7a4ae57a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b01727cea94442bb62b56e7a4ae57a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b01727cea94442bb62b56e7a4ae57a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b01727cea94442bb62b56e7a4ae57a0"}]}] Aug 02 09:15:51.651789 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1040473499 Aug 02 09:15:51.651789 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: 5b01727cea94442bb62b56e7a4ae57a0 Aug 02 09:15:51.651789 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1040473499 Aug 02 09:15:51.651789 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-ServerRescueNegativeTestJSON-1040473499-project Aug 02 09:15:51.651789 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:15:51.651789 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:15:51.651789 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: 1eda94767d1547fa82f6407a4c7de1d8 Aug 02 09:15:51.651789 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1040473499-project Aug 02 09:15:51.651789 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: > Aug 02 09:15:51.651789 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Instance 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d could not be found. Aug 02 09:15:51.651789 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': '351f0943-3d4a-43c0-a57d-2e0bdda1fc4d'} Aug 02 09:15:51.652845 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:15:51.652845 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:15:51.652845 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:15:51.652845 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:15:51.652845 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:15:51.652845 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:15:51.652845 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:15:51.652845 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:15:51.652845 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:15:51.652845 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:15:51.652845 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d could not be found. Aug 02 09:15:51.652845 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:15:51.652845 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:15:51.652845 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:15:51.652845 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:15:51.652845 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:15:51.652845 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:15:51.652845 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:15:51.652845 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:15:51.652845 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:15:51.654556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:15:51.654556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:15:51.654556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:15:51.654556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:15:51.654556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:15:51.654556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:15:51.654556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:15:51.654556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d could not be found. Aug 02 09:15:51.654556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:15:51.654556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:15:51.654556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:15:51.654556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:15:51.654556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:15:51.654556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:15:51.654556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:15:51.654556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:15:51.654556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d could not be found. Aug 02 09:15:51.654556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:15:51.656329 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-84176ca0-6fa4-4c16-a285-bdd0fed6be63 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Returning 404 to user: Instance 351f0943-3d4a-43c0-a57d-2e0bdda1fc4d could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:15:51.656329 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-84176ca0-6fa4-4c16-a285-bdd0fed6be63 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d" status: 404 len: 111 microversion: 2.1 time: 0.036644 Aug 02 09:15:51.656329 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 297/583] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:51 2022] GET /compute/v2.1/servers/351f0943-3d4a-43c0-a57d-2e0bdda1fc4d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:15:51.658352 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-9cd3afcb-09d9-40b8-913b-fa5847319d26 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '.version_select at 0x7ffb9aa975e0>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:51.785596 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-9cd3afcb-09d9-40b8-913b-fa5847319d26 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1521917604" status: 202 len: 0 microversion: 2.1 time: 0.133611 Aug 02 09:15:51.789074 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 287/584] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Aug 2 09:15:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1521917604 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:15:54.918515 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-75bfab5c-8f9d-4845-9df1-50cecd1421cd tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:54.919110 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-75bfab5c-8f9d-4845-9df1-50cecd1421cd tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:54.925828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-75bfab5c-8f9d-4845-9df1-50cecd1421cd tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:54.932035 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-75bfab5c-8f9d-4845-9df1-50cecd1421cd tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:54.932035 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-75bfab5c-8f9d-4845-9df1-50cecd1421cd tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:54.932035 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-75bfab5c-8f9d-4845-9df1-50cecd1421cd tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:54.953834 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-75bfab5c-8f9d-4845-9df1-50cecd1421cd tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5/ips" status: 200 len: 150 microversion: 2.1 time: 0.103934 Aug 02 09:15:54.954304 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 298/585] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 2 09:15:54 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5/ips => generated 150 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:55.235925 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-9f3b15d3-152e-4f60-a7b3-2111ff092a70 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:55.236646 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-9f3b15d3-152e-4f60-a7b3-2111ff092a70 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:55.244737 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9f3b15d3-152e-4f60-a7b3-2111ff092a70 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:55.245265 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9f3b15d3-152e-4f60-a7b3-2111ff092a70 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:55.246051 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9f3b15d3-152e-4f60-a7b3-2111ff092a70 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:55.246486 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9f3b15d3-152e-4f60-a7b3-2111ff092a70 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:55.249383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=80 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:15:55.274760 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-9f3b15d3-152e-4f60-a7b3-2111ff092a70 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Going to try to terminate instance {{(pid=118526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:15:55.701313 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-9f3b15d3-152e-4f60-a7b3-2111ff092a70 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "DELETE /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 204 len: 0 microversion: 2.1 time: 0.469494 Aug 02 09:15:55.701913 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 288/586] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:15:55 2022] DELETE /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:15:55.715788 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-8a849c20-d103-49b3-ab09-a9fd90b20672 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:55.715788 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-8a849c20-d103-49b3-ab09-a9fd90b20672 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:55.718162 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8a849c20-d103-49b3-ab09-a9fd90b20672 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:55.719391 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8a849c20-d103-49b3-ab09-a9fd90b20672 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:55.720491 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8a849c20-d103-49b3-ab09-a9fd90b20672 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:55.720960 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8a849c20-d103-49b3-ab09-a9fd90b20672 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:55.871729 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-8a849c20-d103-49b3-ab09-a9fd90b20672 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:55.880938 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-8a849c20-d103-49b3-ab09-a9fd90b20672 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1508 microversion: 2.1 time: 0.173837 Aug 02 09:15:55.886467 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 299/587] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:55 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:15:56.689209 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-8b1ea71d-f876-42b5-914c-2163be64a728 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1977db22-9180-46e9-8434-914bf712a86f"}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:56.691853 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-8b1ea71d-f876-42b5-914c-2163be64a728 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:56.698893 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-8b1ea71d-f876-42b5-914c-2163be64a728 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:56.699344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-8b1ea71d-f876-42b5-914c-2163be64a728 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:56.700535 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-8b1ea71d-f876-42b5-914c-2163be64a728 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:56.700975 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-8b1ea71d-f876-42b5-914c-2163be64a728 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:56.907164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-3babca70-8cf1-49b8-8784-60eb594fd188 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:56.907734 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-3babca70-8cf1-49b8-8784-60eb594fd188 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:56.914770 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3babca70-8cf1-49b8-8784-60eb594fd188 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:56.915219 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3babca70-8cf1-49b8-8784-60eb594fd188 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:56.916016 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3babca70-8cf1-49b8-8784-60eb594fd188 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:56.916479 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3babca70-8cf1-49b8-8784-60eb594fd188 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:57.055609 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-3babca70-8cf1-49b8-8784-60eb594fd188 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:57.063978 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-3babca70-8cf1-49b8-8784-60eb594fd188 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1508 microversion: 2.1 time: 0.164660 Aug 02 09:15:57.064595 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 300/588] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:56 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1508 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:58.086596 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-24ffe444-d18a-4d3a-b260-10db82ef4ce6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:58.087270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-24ffe444-d18a-4d3a-b260-10db82ef4ce6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:58.094047 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-24ffe444-d18a-4d3a-b260-10db82ef4ce6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:58.094585 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-24ffe444-d18a-4d3a-b260-10db82ef4ce6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:58.095888 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-24ffe444-d18a-4d3a-b260-10db82ef4ce6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:58.096502 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-24ffe444-d18a-4d3a-b260-10db82ef4ce6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:58.260189 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-24ffe444-d18a-4d3a-b260-10db82ef4ce6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:58.269099 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-24ffe444-d18a-4d3a-b260-10db82ef4ce6 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1508 microversion: 2.1 time: 0.186650 Aug 02 09:15:58.269679 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 301/589] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:58 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1508 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:15:58.863774 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-8b1ea71d-f876-42b5-914c-2163be64a728 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "POST /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.180208 Aug 02 09:15:58.864452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 289/590] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 2 09:15:56 2022] POST /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5/os-volume_attachments => generated 194 bytes in 2182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:59.002944 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-d4564c34-f24e-439b-8acc-0b2b89a721f6 req-8e146763-d10e-416f-bdfc-6ff5c0dd6342 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95f38f46-6f77-4c20-bfed-3f60c1fcfad2", "name": "network-vif-deleted", "tag": "f874d599-d036-4473-8b0d-bac60f7e1f6d"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:15:59.013339 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-d4564c34-f24e-439b-8acc-0b2b89a721f6 req-8e146763-d10e-416f-bdfc-6ff5c0dd6342 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:59.014046 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-d4564c34-f24e-439b-8acc-0b2b89a721f6 req-8e146763-d10e-416f-bdfc-6ff5c0dd6342 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:59.027080 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-d4564c34-f24e-439b-8acc-0b2b89a721f6 req-8e146763-d10e-416f-bdfc-6ff5c0dd6342 service nova] Creating event network-vif-deleted:f874d599-d036-4473-8b0d-bac60f7e1f6d for instance 95f38f46-6f77-4c20-bfed-3f60c1fcfad2 on hv-cinder-84599 Aug 02 09:15:59.034227 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-d4564c34-f24e-439b-8acc-0b2b89a721f6 req-8e146763-d10e-416f-bdfc-6ff5c0dd6342 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035602 Aug 02 09:15:59.034958 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 302/591] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:15:59.293180 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-776b144b-8660-46c7-8c45-aa2231f7f091 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:15:59.293981 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-776b144b-8660-46c7-8c45-aa2231f7f091 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:15:59.303140 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-776b144b-8660-46c7-8c45-aa2231f7f091 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:59.303584 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-776b144b-8660-46c7-8c45-aa2231f7f091 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:59.304490 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-776b144b-8660-46c7-8c45-aa2231f7f091 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:59.304933 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-776b144b-8660-46c7-8c45-aa2231f7f091 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:59.347603 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-776b144b-8660-46c7-8c45-aa2231f7f091 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:15:59.348440 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-776b144b-8660-46c7-8c45-aa2231f7f091 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:15:59.349213 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.objects.instance [None req-776b144b-8660-46c7-8c45-aa2231f7f091 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lazy-loading 'fault' on Instance uuid 95f38f46-6f77-4c20-bfed-3f60c1fcfad2 {{(pid=118526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:15:59.406927 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-776b144b-8660-46c7-8c45-aa2231f7f091 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:15:59.419278 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-776b144b-8660-46c7-8c45-aa2231f7f091 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 200 len: 1312 microversion: 2.1 time: 0.130632 Aug 02 09:15:59.419865 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 290/592] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:15:59 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 1312 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:16:00.445688 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-a285095e-5a14-4a63-8d42-08d61c31e13c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:00.446395 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-a285095e-5a14-4a63-8d42-08d61c31e13c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 95f38f46-6f77-4c20-bfed-3f60c1fcfad2] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:00.454429 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a285095e-5a14-4a63-8d42-08d61c31e13c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:00.455166 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a285095e-5a14-4a63-8d42-08d61c31e13c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:00.455908 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a285095e-5a14-4a63-8d42-08d61c31e13c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:00.456411 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a285095e-5a14-4a63-8d42-08d61c31e13c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:00.472791 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-a285095e-5a14-4a63-8d42-08d61c31e13c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] HTTP exception thrown: Instance 95f38f46-6f77-4c20-bfed-3f60c1fcfad2 could not be found. Aug 02 09:16:00.474528 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-a285095e-5a14-4a63-8d42-08d61c31e13c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Request method failure captured: Aug 02 09:16:00.474528 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 HTTP/1.1 Aug 02 09:16:00.474528 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:16:00.474528 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:16:00.474528 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:16:00.474528 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:16:00.474528 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:16:00.474528 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:16:00.474528 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:16:00.474528 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:16:00.474528 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6OoRmwjoNYhYnEcpgvvMEgd2xKWzF42xFe2mQGMLj3xIf2rbW7jLb_M6K5s8XRrNt0jgV2BkoLp__0sW_xWvmzuZaSam16BGZbPOtbFV1QdDLxB4qZlviKTAjvfQC9uvL31nkGmI2TvBy6_wRRQkKYA6ErGyVZGDEB2BoL_ZMmAWEOk Aug 02 09:16:00.474528 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:16:00.474528 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:16:00.474528 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:16:00.474528 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:16:00.474528 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:16:00.474528 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:16:00.474528 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: 5b01727cea94442bb62b56e7a4ae57a0 Aug 02 09:16:00.474528 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1040473499 Aug 02 09:16:00.474528 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:16:00.474528 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:16:00.476089 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b01727cea94442bb62b56e7a4ae57a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b01727cea94442bb62b56e7a4ae57a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b01727cea94442bb62b56e7a4ae57a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b01727cea94442bb62b56e7a4ae57a0"}]}] Aug 02 09:16:00.476089 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1040473499 Aug 02 09:16:00.476089 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: 5b01727cea94442bb62b56e7a4ae57a0 Aug 02 09:16:00.476089 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1040473499 Aug 02 09:16:00.476089 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-ServerRescueNegativeTestJSON-1040473499-project Aug 02 09:16:00.476089 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:16:00.476089 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:16:00.476089 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: 1eda94767d1547fa82f6407a4c7de1d8 Aug 02 09:16:00.476089 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1040473499-project Aug 02 09:16:00.476089 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: > Aug 02 09:16:00.476089 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Instance 95f38f46-6f77-4c20-bfed-3f60c1fcfad2 could not be found. Aug 02 09:16:00.476089 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': '95f38f46-6f77-4c20-bfed-3f60c1fcfad2'} Aug 02 09:16:00.476967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:16:00.476967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:16:00.476967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:16:00.476967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:16:00.476967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:16:00.476967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:16:00.476967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:16:00.476967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:16:00.476967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:16:00.476967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:16:00.476967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95f38f46-6f77-4c20-bfed-3f60c1fcfad2 could not be found. Aug 02 09:16:00.476967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:16:00.476967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:16:00.476967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:16:00.476967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:16:00.476967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:16:00.476967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:16:00.476967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:16:00.476967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:16:00.476967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:16:00.478503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:16:00.478503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:16:00.478503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:16:00.478503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:16:00.478503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:16:00.478503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:16:00.478503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:16:00.478503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95f38f46-6f77-4c20-bfed-3f60c1fcfad2 could not be found. Aug 02 09:16:00.478503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:16:00.478503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:16:00.478503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:16:00.478503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:16:00.478503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:16:00.478503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:16:00.478503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:16:00.478503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:16:00.478503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95f38f46-6f77-4c20-bfed-3f60c1fcfad2 could not be found. Aug 02 09:16:00.478503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:16:00.479734 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-a285095e-5a14-4a63-8d42-08d61c31e13c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Returning 404 to user: Instance 95f38f46-6f77-4c20-bfed-3f60c1fcfad2 could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:16:00.479734 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-a285095e-5a14-4a63-8d42-08d61c31e13c tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2" status: 404 len: 111 microversion: 2.1 time: 0.035596 Aug 02 09:16:00.479734 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 303/593] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:00 2022] GET /compute/v2.1/servers/95f38f46-6f77-4c20-bfed-3f60c1fcfad2 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:16:00.485752 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-9312b486-c064-459d-b395-eaa21469ceda tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:00.486538 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-9312b486-c064-459d-b395-eaa21469ceda tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:00.493731 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9312b486-c064-459d-b395-eaa21469ceda tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:00.494233 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9312b486-c064-459d-b395-eaa21469ceda tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:00.495236 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9312b486-c064-459d-b395-eaa21469ceda tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:00.495667 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9312b486-c064-459d-b395-eaa21469ceda tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:00.528434 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-9312b486-c064-459d-b395-eaa21469ceda tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Going to try to terminate instance {{(pid=118526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:16:00.845822 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=40,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:00.939631 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-9312b486-c064-459d-b395-eaa21469ceda tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "DELETE /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 204 len: 0 microversion: 2.1 time: 0.457523 Aug 02 09:16:00.940259 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 291/594] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:16:00 2022] DELETE /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 09:16:00.948965 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-efe7bf5b-e9ab-4761-87ce-22987de04ae1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:00.949641 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-efe7bf5b-e9ab-4761-87ce-22987de04ae1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:00.961010 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-efe7bf5b-e9ab-4761-87ce-22987de04ae1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:00.962366 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-efe7bf5b-e9ab-4761-87ce-22987de04ae1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:00.963338 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-efe7bf5b-e9ab-4761-87ce-22987de04ae1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:00.963918 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-efe7bf5b-e9ab-4761-87ce-22987de04ae1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:01.163329 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-efe7bf5b-e9ab-4761-87ce-22987de04ae1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:01.173695 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-efe7bf5b-e9ab-4761-87ce-22987de04ae1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1521 microversion: 2.1 time: 0.228625 Aug 02 09:16:01.174281 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 304/595] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:00 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1521 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:02.197172 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-087e2325-536f-4665-bf13-81179ca0804d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:02.197875 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-087e2325-536f-4665-bf13-81179ca0804d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:02.206388 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-087e2325-536f-4665-bf13-81179ca0804d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:02.206831 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-087e2325-536f-4665-bf13-81179ca0804d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:02.207687 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-087e2325-536f-4665-bf13-81179ca0804d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:02.208117 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-087e2325-536f-4665-bf13-81179ca0804d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:02.359455 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-087e2325-536f-4665-bf13-81179ca0804d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:02.367572 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-087e2325-536f-4665-bf13-81179ca0804d tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1521 microversion: 2.1 time: 0.175330 Aug 02 09:16:02.368175 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 292/596] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:02 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:03.389493 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-1552e610-c880-498c-adaf-da3178b87665 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:03.390157 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-1552e610-c880-498c-adaf-da3178b87665 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:03.397567 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1552e610-c880-498c-adaf-da3178b87665 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:03.398024 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1552e610-c880-498c-adaf-da3178b87665 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:03.398838 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1552e610-c880-498c-adaf-da3178b87665 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:03.399287 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1552e610-c880-498c-adaf-da3178b87665 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:03.551950 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-1552e610-c880-498c-adaf-da3178b87665 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:03.560493 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-1552e610-c880-498c-adaf-da3178b87665 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1521 microversion: 2.1 time: 0.174924 Aug 02 09:16:03.561073 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 305/597] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:03 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:16:04.586707 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-2557e2e1-30ae-4c39-9aac-5b49b85bb9fb tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:04.587708 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-2557e2e1-30ae-4c39-9aac-5b49b85bb9fb tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:04.599005 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2557e2e1-30ae-4c39-9aac-5b49b85bb9fb tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:04.599458 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2557e2e1-30ae-4c39-9aac-5b49b85bb9fb tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:04.600297 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2557e2e1-30ae-4c39-9aac-5b49b85bb9fb tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:04.601007 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2557e2e1-30ae-4c39-9aac-5b49b85bb9fb tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:04.828371 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-2557e2e1-30ae-4c39-9aac-5b49b85bb9fb tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:04.839804 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-2557e2e1-30ae-4c39-9aac-5b49b85bb9fb tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1521 microversion: 2.1 time: 0.260056 Aug 02 09:16:04.841193 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 293/598] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:04 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:05.381816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-837f6730-2c00-4432-9a09-f6fb775dfc0f tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:05.458301 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-837f6730-2c00-4432-9a09-f6fb775dfc0f tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:05.458301 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-837f6730-2c00-4432-9a09-f6fb775dfc0f tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:05.458301 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-837f6730-2c00-4432-9a09-f6fb775dfc0f tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:05.458301 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-837f6730-2c00-4432-9a09-f6fb775dfc0f tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:05.459409 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-837f6730-2c00-4432-9a09-f6fb775dfc0f tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:05.459513 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-52f1374f-e5eb-4b8b-8e97-d940643ada08 req-250dee45-b87a-4af4-9835-aad2e972c64c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44854eb9-caa3-4fc7-bd14-6a150fcafcd3", "name": "network-vif-deleted", "tag": "da035960-2909-47c1-95e2-3f882cc28445"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:05.459513 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-52f1374f-e5eb-4b8b-8e97-d940643ada08 req-250dee45-b87a-4af4-9835-aad2e972c64c service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:05.459513 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-52f1374f-e5eb-4b8b-8e97-d940643ada08 req-250dee45-b87a-4af4-9835-aad2e972c64c service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:05.460208 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.objects.instance [None req-837f6730-2c00-4432-9a09-f6fb775dfc0f tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lazy-loading 'flavor' on Instance uuid c36b6524-980c-4f56-b1ad-e71536c08577 {{(pid=118526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:16:05.460410 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-52f1374f-e5eb-4b8b-8e97-d940643ada08 req-250dee45-b87a-4af4-9835-aad2e972c64c service nova] Creating event network-vif-deleted:da035960-2909-47c1-95e2-3f882cc28445 for instance 44854eb9-caa3-4fc7-bd14-6a150fcafcd3 on hv-cinder-84599 Aug 02 09:16:05.460410 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-52f1374f-e5eb-4b8b-8e97-d940643ada08 req-250dee45-b87a-4af4-9835-aad2e972c64c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142472 Aug 02 09:16:05.460410 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 306/599] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:05.843148 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-837f6730-2c00-4432-9a09-f6fb775dfc0f tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "POST /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577/action" status: 202 len: 0 microversion: 2.1 time: 0.467394 Aug 02 09:16:05.844039 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 294/600] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 2 09:16:05 2022] POST /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 09:16:05.854094 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-82f6b4aa-af4f-41ec-872c-b00875c55f7a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:05.855189 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-82f6b4aa-af4f-41ec-872c-b00875c55f7a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:05.866843 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-82f6b4aa-af4f-41ec-872c-b00875c55f7a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:05.867718 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-82f6b4aa-af4f-41ec-872c-b00875c55f7a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:05.869251 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-82f6b4aa-af4f-41ec-872c-b00875c55f7a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:05.870046 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-316ef4d8-92e7-4da9-a34c-b72bb5229aad tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:05.870319 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-82f6b4aa-af4f-41ec-872c-b00875c55f7a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:05.871332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-316ef4d8-92e7-4da9-a34c-b72bb5229aad tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:05.881884 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-316ef4d8-92e7-4da9-a34c-b72bb5229aad tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:05.882962 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-316ef4d8-92e7-4da9-a34c-b72bb5229aad tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:05.884666 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-316ef4d8-92e7-4da9-a34c-b72bb5229aad tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:05.885562 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-316ef4d8-92e7-4da9-a34c-b72bb5229aad tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:06.006463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-316ef4d8-92e7-4da9-a34c-b72bb5229aad tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:06.014338 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-316ef4d8-92e7-4da9-a34c-b72bb5229aad tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1306 microversion: 2.1 time: 0.153827 Aug 02 09:16:06.014918 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 295/601] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:05 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1306 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:06.088558 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-82f6b4aa-af4f-41ec-872c-b00875c55f7a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:06.097482 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-82f6b4aa-af4f-41ec-872c-b00875c55f7a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1567 microversion: 2.1 time: 0.247665 Aug 02 09:16:06.099096 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 307/602] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:05 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1567 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:16:07.037893 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-d83a94ab-7336-48d6-8e78-2aaad4657b60 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:07.038508 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-d83a94ab-7336-48d6-8e78-2aaad4657b60 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:07.046491 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d83a94ab-7336-48d6-8e78-2aaad4657b60 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:07.047004 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d83a94ab-7336-48d6-8e78-2aaad4657b60 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:07.047805 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d83a94ab-7336-48d6-8e78-2aaad4657b60 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:07.048286 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d83a94ab-7336-48d6-8e78-2aaad4657b60 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:07.082645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d83a94ab-7336-48d6-8e78-2aaad4657b60 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:07.083104 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d83a94ab-7336-48d6-8e78-2aaad4657b60 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:07.083756 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.objects.instance [None req-d83a94ab-7336-48d6-8e78-2aaad4657b60 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lazy-loading 'fault' on Instance uuid 44854eb9-caa3-4fc7-bd14-6a150fcafcd3 {{(pid=118526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:16:07.119515 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-f9f4e1e6-51c1-45d8-bcf4-ca9b2df34336 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:07.120122 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-f9f4e1e6-51c1-45d8-bcf4-ca9b2df34336 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:07.127132 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f9f4e1e6-51c1-45d8-bcf4-ca9b2df34336 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:07.128702 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f9f4e1e6-51c1-45d8-bcf4-ca9b2df34336 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:07.129872 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f9f4e1e6-51c1-45d8-bcf4-ca9b2df34336 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:07.130652 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f9f4e1e6-51c1-45d8-bcf4-ca9b2df34336 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:07.142905 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-d83a94ab-7336-48d6-8e78-2aaad4657b60 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1eda94767d1547fa82f6407a4c7de1d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b01727cea94442bb62b56e7a4ae57a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:07.144508 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-d83a94ab-7336-48d6-8e78-2aaad4657b60 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 200 len: 1311 microversion: 2.1 time: 0.110040 Aug 02 09:16:07.145101 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 296/603] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:07 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 1311 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:07.283741 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-f9f4e1e6-51c1-45d8-bcf4-ca9b2df34336 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:07.292262 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-f9f4e1e6-51c1-45d8-bcf4-ca9b2df34336 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1567 microversion: 2.1 time: 0.176518 Aug 02 09:16:07.292836 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 308/604] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:07 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:07.592744 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-00c0ebc4-635c-426e-b049-0994c93df74e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1977db22-9180-46e9-8434-914bf712a86f"}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:07.595289 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-00c0ebc4-635c-426e-b049-0994c93df74e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:07.602280 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-00c0ebc4-635c-426e-b049-0994c93df74e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:07.602735 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-00c0ebc4-635c-426e-b049-0994c93df74e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:07.603511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-00c0ebc4-635c-426e-b049-0994c93df74e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:07.603948 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-00c0ebc4-635c-426e-b049-0994c93df74e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:07.618890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:07.688889 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-00c0ebc4-635c-426e-b049-0994c93df74e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] HTTP exception thrown: Invalid volume: volume 1977db22-9180-46e9-8434-914bf712a86f is already attached to instances: 0331a7cf-074f-4e27-b452-e057f9b422c5 Aug 02 09:16:07.691645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-00c0ebc4-635c-426e-b049-0994c93df74e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Request method failure captured: Aug 02 09:16:07.691645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: POST /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5/os-volume_attachments HTTP/1.1 Aug 02 09:16:07.691645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:16:07.691645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:16:07.691645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:16:07.691645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 74 Aug 02 09:16:07.691645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:16:07.691645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:16:07.691645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:16:07.691645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:16:07.691645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OoKOsXfjNTp1mjsj6r1IgBAgQBzTLiQjJO0bR1TldRTpxWx6tSFZWanW3Gv02s-EY-9kVRC92iBnbzPS2ztWMdgardIrvDP60IsZABewH2eMK4dXX1f7Hpv6gsaQwPQ8jW613IMovFbfYZIhNfO_yD-aTLWmHXV3Hwct_s6HofR820 Aug 02 09:16:07.691645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:16:07.691645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:16:07.691645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:16:07.691645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:16:07.691645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:16:07.691645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:16:07.691645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:16:07.691645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:16:07.691645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:16:07.691645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:16:07.693178 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6fc6b07497a48eeb263b3a9b8aa7499"}]}] Aug 02 09:16:07.693178 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:16:07.693178 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:16:07.693178 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:16:07.693178 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:16:07.693178 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:16:07.693178 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:16:07.693178 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: ad3a9141e9284bb5a096fb04d3e9d581 Aug 02 09:16:07.693178 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:16:07.693178 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Aug 02 09:16:07.693178 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {"volumeAttachment": {"volumeId": "1977db22-9180-46e9-8434-914bf712a86f"}} Aug 02 09:16:07.693178 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:16:07.694038 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Invalid volume: volume 1977db22-9180-46e9-8434-914bf712a86f is already attached to instances: 0331a7cf-074f-4e27-b452-e057f9b422c5 Aug 02 09:16:07.694038 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'server_id': '0331a7cf-074f-4e27-b452-e057f9b422c5', 'body': {'volumeAttachment': {'volumeId': '1977db22-9180-46e9-8434-914bf712a86f'}}} Aug 02 09:16:07.694038 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:16:07.694038 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:16:07.694038 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 02 09:16:07.694038 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 02 09:16:07.694038 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 02 09:16:07.694038 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 02 09:16:07.694038 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 02 09:16:07.694038 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 02 09:16:07.694038 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5066, in attach_volume Aug 02 09:16:07.694038 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 02 09:16:07.694038 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4906, in _check_volume_already_attached Aug 02 09:16:07.694038 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 02 09:16:07.694038 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1977db22-9180-46e9-8434-914bf712a86f is already attached to instances: 0331a7cf-074f-4e27-b452-e057f9b422c5 Aug 02 09:16:07.694038 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:16:07.694038 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:16:07.694038 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:16:07.694038 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:16:07.695433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:16:07.695433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:16:07.695433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:16:07.695433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:16:07.695433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:16:07.695433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:16:07.695433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:16:07.695433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:16:07.695433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:16:07.695433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:16:07.695433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 02 09:16:07.695433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 02 09:16:07.695433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 02 09:16:07.695433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 02 09:16:07.695433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1977db22-9180-46e9-8434-914bf712a86f is already attached to instances: 0331a7cf-074f-4e27-b452-e057f9b422c5 Aug 02 09:16:07.695433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:16:07.695433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:16:07.695433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:16:07.695433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:16:07.695433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:16:07.698998 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:16:07.698998 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:16:07.698998 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:16:07.698998 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1977db22-9180-46e9-8434-914bf712a86f is already attached to instances: 0331a7cf-074f-4e27-b452-e057f9b422c5 Aug 02 09:16:07.698998 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:16:07.698998 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-00c0ebc4-635c-426e-b049-0994c93df74e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Returning 400 to user: Invalid volume: volume 1977db22-9180-46e9-8434-914bf712a86f is already attached to instances: 0331a7cf-074f-4e27-b452-e057f9b422c5 {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:16:07.698998 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-00c0ebc4-635c-426e-b049-0994c93df74e tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "POST /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104657 Aug 02 09:16:07.698998 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 297/605] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 2 09:16:07 2022] POST /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:16:07.769440 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-80cfc881-a57d-47d5-8c3a-27238613e540 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:07.769937 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-80cfc881-a57d-47d5-8c3a-27238613e540 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:07.776063 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-80cfc881-a57d-47d5-8c3a-27238613e540 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:07.776547 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-80cfc881-a57d-47d5-8c3a-27238613e540 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:07.777314 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-80cfc881-a57d-47d5-8c3a-27238613e540 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:07.777749 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-80cfc881-a57d-47d5-8c3a-27238613e540 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:07.780471 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:07.871027 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.objects.instance [None req-80cfc881-a57d-47d5-8c3a-27238613e540 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lazy-loading 'services' on Instance uuid 0331a7cf-074f-4e27-b452-e057f9b422c5 {{(pid=118525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:16:08.158370 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-3a088e74-d366-498d-8833-044df0933186 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:08.161212 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-3a088e74-d366-498d-8833-044df0933186 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:08.169243 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3a088e74-d366-498d-8833-044df0933186 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:08.169819 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3a088e74-d366-498d-8833-044df0933186 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:08.170617 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3a088e74-d366-498d-8833-044df0933186 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:08.171059 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3a088e74-d366-498d-8833-044df0933186 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:08.202039 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-3a088e74-d366-498d-8833-044df0933186 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048037 Aug 02 09:16:08.202558 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 298/606] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:16:08 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 09:16:08.208723 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c7f10cf1-5e20-4f97-9217-d6a0d5b398b1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:08.209471 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-c7f10cf1-5e20-4f97-9217-d6a0d5b398b1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] [instance: 44854eb9-caa3-4fc7-bd14-6a150fcafcd3] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:08.215778 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c7f10cf1-5e20-4f97-9217-d6a0d5b398b1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:08.217512 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c7f10cf1-5e20-4f97-9217-d6a0d5b398b1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:08.217512 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c7f10cf1-5e20-4f97-9217-d6a0d5b398b1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:08.217727 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c7f10cf1-5e20-4f97-9217-d6a0d5b398b1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:08.231959 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-c7f10cf1-5e20-4f97-9217-d6a0d5b398b1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] HTTP exception thrown: Instance 44854eb9-caa3-4fc7-bd14-6a150fcafcd3 could not be found. Aug 02 09:16:08.233589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c7f10cf1-5e20-4f97-9217-d6a0d5b398b1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Request method failure captured: Aug 02 09:16:08.233589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 HTTP/1.1 Aug 02 09:16:08.233589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:16:08.233589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:16:08.233589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:16:08.233589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:16:08.233589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:16:08.233589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:16:08.233589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:16:08.233589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:16:08.233589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OoRmwjoNYhYnEcpgvvMEgd2xKWzF42xFe2mQGMLj3xIf2rbW7jLb_M6K5s8XRrNt0jgV2BkoLp__0sW_xWvmzuZaSam16BGZbPOtbFV1QdDLxB4qZlviKTAjvfQC9uvL31nkGmI2TvBy6_wRRQkKYA6ErGyVZGDEB2BoL_ZMmAWEOk Aug 02 09:16:08.233589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:16:08.233589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:16:08.233589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:16:08.233589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:16:08.233589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:16:08.233589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:16:08.233589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: 5b01727cea94442bb62b56e7a4ae57a0 Aug 02 09:16:08.233589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1040473499 Aug 02 09:16:08.233589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:16:08.233589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:16:08.235124 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b01727cea94442bb62b56e7a4ae57a0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/5b01727cea94442bb62b56e7a4ae57a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/5b01727cea94442bb62b56e7a4ae57a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_5b01727cea94442bb62b56e7a4ae57a0"}]}] Aug 02 09:16:08.235124 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1040473499 Aug 02 09:16:08.235124 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: 5b01727cea94442bb62b56e7a4ae57a0 Aug 02 09:16:08.235124 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1040473499 Aug 02 09:16:08.235124 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-ServerRescueNegativeTestJSON-1040473499-project Aug 02 09:16:08.235124 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:16:08.235124 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:16:08.235124 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: 1eda94767d1547fa82f6407a4c7de1d8 Aug 02 09:16:08.235124 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1040473499-project Aug 02 09:16:08.235124 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:16:08.235124 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Instance 44854eb9-caa3-4fc7-bd14-6a150fcafcd3 could not be found. Aug 02 09:16:08.235124 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'id': '44854eb9-caa3-4fc7-bd14-6a150fcafcd3'} Aug 02 09:16:08.235990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:16:08.235990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:16:08.235990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:16:08.235990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:16:08.235990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:16:08.235990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:16:08.235990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:16:08.235990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:16:08.235990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:16:08.235990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:16:08.235990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44854eb9-caa3-4fc7-bd14-6a150fcafcd3 could not be found. Aug 02 09:16:08.235990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:16:08.235990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:16:08.235990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:16:08.235990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:16:08.235990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:16:08.235990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:16:08.235990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:16:08.235990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:16:08.235990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:16:08.238902 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:16:08.238902 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:16:08.238902 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:16:08.238902 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:16:08.238902 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:16:08.238902 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:16:08.238902 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:16:08.238902 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44854eb9-caa3-4fc7-bd14-6a150fcafcd3 could not be found. Aug 02 09:16:08.238902 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:16:08.238902 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:16:08.238902 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:16:08.238902 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:16:08.238902 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:16:08.238902 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:16:08.238902 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:16:08.238902 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:16:08.238902 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44854eb9-caa3-4fc7-bd14-6a150fcafcd3 could not be found. Aug 02 09:16:08.238902 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:16:08.242784 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c7f10cf1-5e20-4f97-9217-d6a0d5b398b1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] Returning 404 to user: Instance 44854eb9-caa3-4fc7-bd14-6a150fcafcd3 could not be found. {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:16:08.242784 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-c7f10cf1-5e20-4f97-9217-d6a0d5b398b1 tempest-ServerRescueNegativeTestJSON-1040473499 tempest-ServerRescueNegativeTestJSON-1040473499-project] 10.222.0.20 "GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3" status: 404 len: 111 microversion: 2.1 time: 0.030287 Aug 02 09:16:08.242784 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 299/607] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:08 2022] GET /compute/v2.1/servers/44854eb9-caa3-4fc7-bd14-6a150fcafcd3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:16:08.244118 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-80cfc881-a57d-47d5-8c3a-27238613e540 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5/os-volume_attachments/1977db22-9180-46e9-8434-914bf712a86f" status: 202 len: 0 microversion: 2.1 time: 0.478846 Aug 02 09:16:08.251420 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 309/608] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 2 09:16:07 2022] DELETE /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5/os-volume_attachments/1977db22-9180-46e9-8434-914bf712a86f => generated 0 bytes in 487 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:16:08.259753 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-58f3dd53-72b1-47fe-ae69-350836bf4e98 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:08.262160 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-58f3dd53-72b1-47fe-ae69-350836bf4e98 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:08.269354 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-58f3dd53-72b1-47fe-ae69-350836bf4e98 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:08.269852 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-58f3dd53-72b1-47fe-ae69-350836bf4e98 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:08.271100 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-58f3dd53-72b1-47fe-ae69-350836bf4e98 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:08.271742 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-58f3dd53-72b1-47fe-ae69-350836bf4e98 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:08.277440 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-418ddd78-7d4a-4dbe-b8fe-aa479f8f12b1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:08.277909 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-418ddd78-7d4a-4dbe-b8fe-aa479f8f12b1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:08.285181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-418ddd78-7d4a-4dbe-b8fe-aa479f8f12b1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:08.286066 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-418ddd78-7d4a-4dbe-b8fe-aa479f8f12b1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:08.287037 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-418ddd78-7d4a-4dbe-b8fe-aa479f8f12b1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:08.287634 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-418ddd78-7d4a-4dbe-b8fe-aa479f8f12b1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:08.309642 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-58f3dd53-72b1-47fe-ae69-350836bf4e98 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053871 Aug 02 09:16:08.310242 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 300/609] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:16:08 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:08.317787 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-888683bc-7be9-42cb-9e45-b36c46f83210 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:08.318436 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-888683bc-7be9-42cb-9e45-b36c46f83210 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:08.322450 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-418ddd78-7d4a-4dbe-b8fe-aa479f8f12b1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Going to try to terminate instance {{(pid=118525) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:16:08.325336 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-888683bc-7be9-42cb-9e45-b36c46f83210 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:08.325706 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-888683bc-7be9-42cb-9e45-b36c46f83210 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:08.326486 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-888683bc-7be9-42cb-9e45-b36c46f83210 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:08.326928 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-888683bc-7be9-42cb-9e45-b36c46f83210 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:08.509144 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-888683bc-7be9-42cb-9e45-b36c46f83210 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:08.517444 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-888683bc-7be9-42cb-9e45-b36c46f83210 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1567 microversion: 2.1 time: 0.204177 Aug 02 09:16:08.518124 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 301/610] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:08 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:08.663693 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-418ddd78-7d4a-4dbe-b8fe-aa479f8f12b1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "DELETE /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 204 len: 0 microversion: 2.1 time: 0.391989 Aug 02 09:16:08.664300 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 310/611] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:16:08 2022] DELETE /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:16:08.672972 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a1cc91eb-6a7c-48e6-b411-288e01a4c5ec tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:08.673671 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-a1cc91eb-6a7c-48e6-b411-288e01a4c5ec tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:08.680583 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a1cc91eb-6a7c-48e6-b411-288e01a4c5ec tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:08.681023 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a1cc91eb-6a7c-48e6-b411-288e01a4c5ec tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:08.681796 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a1cc91eb-6a7c-48e6-b411-288e01a4c5ec tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:08.682230 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a1cc91eb-6a7c-48e6-b411-288e01a4c5ec tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:08.825180 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-a1cc91eb-6a7c-48e6-b411-288e01a4c5ec tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:08.833749 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-a1cc91eb-6a7c-48e6-b411-288e01a4c5ec tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1670 microversion: 2.1 time: 0.164887 Aug 02 09:16:08.834326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 302/612] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:08 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1670 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:09.323246 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-f26f352f-985a-4c9d-8348-2dc7d103413a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:09.325805 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-f26f352f-985a-4c9d-8348-2dc7d103413a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:09.333283 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f26f352f-985a-4c9d-8348-2dc7d103413a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:09.333733 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f26f352f-985a-4c9d-8348-2dc7d103413a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:09.334516 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f26f352f-985a-4c9d-8348-2dc7d103413a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:09.334950 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f26f352f-985a-4c9d-8348-2dc7d103413a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:09.367185 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-f26f352f-985a-4c9d-8348-2dc7d103413a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048290 Aug 02 09:16:09.372150 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 311/613] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:16:09 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:09.539923 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c9837b56-e5cb-44b5-acfd-2ccc64fd718d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:09.540563 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-c9837b56-e5cb-44b5-acfd-2ccc64fd718d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:09.547446 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c9837b56-e5cb-44b5-acfd-2ccc64fd718d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:09.547876 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c9837b56-e5cb-44b5-acfd-2ccc64fd718d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:09.548682 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c9837b56-e5cb-44b5-acfd-2ccc64fd718d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:09.549114 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c9837b56-e5cb-44b5-acfd-2ccc64fd718d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:09.709253 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-c9837b56-e5cb-44b5-acfd-2ccc64fd718d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:09.718804 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-c9837b56-e5cb-44b5-acfd-2ccc64fd718d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1567 microversion: 2.1 time: 0.182630 Aug 02 09:16:09.732209 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 303/614] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:09 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:16:09.856033 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d5e9713a-2ce7-4f24-bffa-d0fcf4a28135 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:09.856842 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-d5e9713a-2ce7-4f24-bffa-d0fcf4a28135 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:09.864524 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d5e9713a-2ce7-4f24-bffa-d0fcf4a28135 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:09.865074 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d5e9713a-2ce7-4f24-bffa-d0fcf4a28135 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:09.865939 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d5e9713a-2ce7-4f24-bffa-d0fcf4a28135 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:09.866537 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d5e9713a-2ce7-4f24-bffa-d0fcf4a28135 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:10.019825 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d5e9713a-2ce7-4f24-bffa-d0fcf4a28135 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:10.027882 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-d5e9713a-2ce7-4f24-bffa-d0fcf4a28135 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1670 microversion: 2.1 time: 0.176432 Aug 02 09:16:10.038695 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 312/615] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:09 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1670 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:10.379870 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-37003c73-8861-4e93-8cb5-2fec1c3ced19 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:10.382443 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-37003c73-8861-4e93-8cb5-2fec1c3ced19 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:10.388861 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-37003c73-8861-4e93-8cb5-2fec1c3ced19 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:10.389410 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-37003c73-8861-4e93-8cb5-2fec1c3ced19 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:10.390254 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-37003c73-8861-4e93-8cb5-2fec1c3ced19 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:10.390757 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-37003c73-8861-4e93-8cb5-2fec1c3ced19 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:10.421411 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-37003c73-8861-4e93-8cb5-2fec1c3ced19 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046144 Aug 02 09:16:10.421898 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 304/616] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:16:10 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:10.747267 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-73556d1a-8d95-4653-bf5d-b5da73a15b27 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:10.749324 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-73556d1a-8d95-4653-bf5d-b5da73a15b27 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:10.755813 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-da0717f2-2401-4404-91fd-d195428aa74b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:10.757748 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-da0717f2-2401-4404-91fd-d195428aa74b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:10.769800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-73556d1a-8d95-4653-bf5d-b5da73a15b27 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:10.769800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-73556d1a-8d95-4653-bf5d-b5da73a15b27 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:10.769800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-73556d1a-8d95-4653-bf5d-b5da73a15b27 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:10.770442 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-73556d1a-8d95-4653-bf5d-b5da73a15b27 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:10.774208 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-da0717f2-2401-4404-91fd-d195428aa74b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:10.775138 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-da0717f2-2401-4404-91fd-d195428aa74b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:10.776099 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-da0717f2-2401-4404-91fd-d195428aa74b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:10.776732 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-da0717f2-2401-4404-91fd-d195428aa74b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:10.804356 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-da0717f2-2401-4404-91fd-d195428aa74b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5/ips" status: 200 len: 150 microversion: 2.20 time: 0.138456 Aug 02 09:16:10.812318 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 313/617] 10.222.0.20 () {60 vars in 1289 bytes} [Tue Aug 2 09:16:10 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5/ips => generated 150 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:16:10.980154 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-73556d1a-8d95-4653-bf5d-b5da73a15b27 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:10.989232 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-73556d1a-8d95-4653-bf5d-b5da73a15b27 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1567 microversion: 2.1 time: 0.250340 Aug 02 09:16:11.048067 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 305/618] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:10 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1567 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:16:11.052470 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-6846fe61-a98a-4cb0-9b73-8f29373dc078 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:11.053102 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-6846fe61-a98a-4cb0-9b73-8f29373dc078 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:11.060087 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6846fe61-a98a-4cb0-9b73-8f29373dc078 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:11.060575 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6846fe61-a98a-4cb0-9b73-8f29373dc078 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:11.061402 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6846fe61-a98a-4cb0-9b73-8f29373dc078 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:11.061843 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6846fe61-a98a-4cb0-9b73-8f29373dc078 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:11.215127 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-6846fe61-a98a-4cb0-9b73-8f29373dc078 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:11.224536 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-6846fe61-a98a-4cb0-9b73-8f29373dc078 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1670 microversion: 2.1 time: 0.176788 Aug 02 09:16:11.225150 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 314/619] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:11 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1670 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:11.434106 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-db06f528-130f-4d0f-a54a-d4065a4b0032 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:11.436488 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-db06f528-130f-4d0f-a54a-d4065a4b0032 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:11.445517 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-db06f528-130f-4d0f-a54a-d4065a4b0032 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:11.445963 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-db06f528-130f-4d0f-a54a-d4065a4b0032 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:11.446737 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-db06f528-130f-4d0f-a54a-d4065a4b0032 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:11.447178 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-db06f528-130f-4d0f-a54a-d4065a4b0032 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:11.495666 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-db06f528-130f-4d0f-a54a-d4065a4b0032 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065415 Aug 02 09:16:11.503242 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 306/620] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:16:11 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:12.086447 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4de56ef7-d82d-4222-872a-cfeac51e7330 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:12.089862 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-4de56ef7-d82d-4222-872a-cfeac51e7330 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:12.104661 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4de56ef7-d82d-4222-872a-cfeac51e7330 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:12.105684 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4de56ef7-d82d-4222-872a-cfeac51e7330 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:12.107594 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4de56ef7-d82d-4222-872a-cfeac51e7330 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:12.109013 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4de56ef7-d82d-4222-872a-cfeac51e7330 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:12.261493 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a3a41790-c22b-4c93-b829-64978a2ab78f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:12.264461 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-a3a41790-c22b-4c93-b829-64978a2ab78f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:12.313385 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a3a41790-c22b-4c93-b829-64978a2ab78f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:12.313385 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a3a41790-c22b-4c93-b829-64978a2ab78f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:12.313385 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a3a41790-c22b-4c93-b829-64978a2ab78f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:12.314371 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a3a41790-c22b-4c93-b829-64978a2ab78f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:12.561490 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-4de56ef7-d82d-4222-872a-cfeac51e7330 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:12.573710 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-4de56ef7-d82d-4222-872a-cfeac51e7330 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1567 microversion: 2.1 time: 0.505111 Aug 02 09:16:12.590500 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 315/621] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:12 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1567 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:12.595683 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-7faf029e-d556-4e6b-a317-82188fdeae27 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:12.599060 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-7faf029e-d556-4e6b-a317-82188fdeae27 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:12.609790 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7faf029e-d556-4e6b-a317-82188fdeae27 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:12.610312 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7faf029e-d556-4e6b-a317-82188fdeae27 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:12.611186 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7faf029e-d556-4e6b-a317-82188fdeae27 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:12.611731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7faf029e-d556-4e6b-a317-82188fdeae27 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:12.653855 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-7faf029e-d556-4e6b-a317-82188fdeae27 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061988 Aug 02 09:16:12.654654 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 316/622] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:16:12 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:16:12.764518 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-117947bb-8870-4fc0-a019-e32041d922e8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:12.765319 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-117947bb-8870-4fc0-a019-e32041d922e8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:12.774060 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-117947bb-8870-4fc0-a019-e32041d922e8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:12.774867 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-117947bb-8870-4fc0-a019-e32041d922e8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:12.775718 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-117947bb-8870-4fc0-a019-e32041d922e8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:12.776372 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-117947bb-8870-4fc0-a019-e32041d922e8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:12.808593 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-117947bb-8870-4fc0-a019-e32041d922e8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Going to try to terminate instance {{(pid=118525) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:16:12.852110 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-a3a41790-c22b-4c93-b829-64978a2ab78f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:12.870258 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-a3a41790-c22b-4c93-b829-64978a2ab78f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1670 microversion: 2.1 time: 0.625756 Aug 02 09:16:12.870860 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 307/623] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:12 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1670 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:13.285315 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-117947bb-8870-4fc0-a019-e32041d922e8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 204 len: 0 microversion: 2.1 time: 0.522860 Aug 02 09:16:13.285315 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 317/624] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:16:12 2022] DELETE /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 09:16:13.296251 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-bbc993aa-da7a-4b82-9619-ed9d9cf5c528 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:13.297244 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-bbc993aa-da7a-4b82-9619-ed9d9cf5c528 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:13.308391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bbc993aa-da7a-4b82-9619-ed9d9cf5c528 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:13.310922 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bbc993aa-da7a-4b82-9619-ed9d9cf5c528 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:13.312543 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bbc993aa-da7a-4b82-9619-ed9d9cf5c528 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:13.313500 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bbc993aa-da7a-4b82-9619-ed9d9cf5c528 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:13.533555 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-375be88b-7dba-45d1-8562-49a250bda27f req-508b2cba-1b3f-4f98-938b-7a9851fd7ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "73c852c4-c5c3-4a1f-94b9-f6515a830bbb", "name": "network-vif-deleted", "tag": "d833b29e-12d4-4f6f-b2fe-e1239d280814"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:13.563141 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-375be88b-7dba-45d1-8562-49a250bda27f req-508b2cba-1b3f-4f98-938b-7a9851fd7ed8 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:13.564831 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-375be88b-7dba-45d1-8562-49a250bda27f req-508b2cba-1b3f-4f98-938b-7a9851fd7ed8 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:13.589867 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-375be88b-7dba-45d1-8562-49a250bda27f req-508b2cba-1b3f-4f98-938b-7a9851fd7ed8 service nova] Creating event network-vif-deleted:d833b29e-12d4-4f6f-b2fe-e1239d280814 for instance 73c852c4-c5c3-4a1f-94b9-f6515a830bbb on hv-cinder-84599 Aug 02 09:16:13.605816 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-375be88b-7dba-45d1-8562-49a250bda27f req-508b2cba-1b3f-4f98-938b-7a9851fd7ed8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085199 Aug 02 09:16:13.615738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 318/625] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:13.628786 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-e381f154-316c-449f-8fb7-9bca79e64cce tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:13.632679 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-e381f154-316c-449f-8fb7-9bca79e64cce tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:13.642661 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e381f154-316c-449f-8fb7-9bca79e64cce tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:13.644081 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e381f154-316c-449f-8fb7-9bca79e64cce tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:13.645322 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e381f154-316c-449f-8fb7-9bca79e64cce tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:13.645988 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e381f154-316c-449f-8fb7-9bca79e64cce tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:13.656018 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-bbc993aa-da7a-4b82-9619-ed9d9cf5c528 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:13.686912 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-bbc993aa-da7a-4b82-9619-ed9d9cf5c528 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 200 len: 1682 microversion: 2.1 time: 0.397529 Aug 02 09:16:13.687781 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 308/626] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:13 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 1682 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:16:13.700377 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.objects.instance [None req-e381f154-316c-449f-8fb7-9bca79e64cce tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lazy-loading 'flavor' on Instance uuid b54fded6-ca19-48e6-b971-31f061cce0c5 {{(pid=118525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:16:13.741535 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-cff14fd2-7bfa-4b92-b7ee-cc6e61f4b756 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:13.741535 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-cff14fd2-7bfa-4b92-b7ee-cc6e61f4b756 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:13.749024 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cff14fd2-7bfa-4b92-b7ee-cc6e61f4b756 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:13.749475 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cff14fd2-7bfa-4b92-b7ee-cc6e61f4b756 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:13.750259 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cff14fd2-7bfa-4b92-b7ee-cc6e61f4b756 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:13.753038 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cff14fd2-7bfa-4b92-b7ee-cc6e61f4b756 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:13.944066 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-cff14fd2-7bfa-4b92-b7ee-cc6e61f4b756 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:13.953716 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-cff14fd2-7bfa-4b92-b7ee-cc6e61f4b756 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1567 microversion: 2.1 time: 0.234722 Aug 02 09:16:13.957070 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 309/627] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:13 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:13.960024 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-641d16a8-f1e8-4699-b170-6f18bff1781a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:13.960685 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-641d16a8-f1e8-4699-b170-6f18bff1781a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:13.966622 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-641d16a8-f1e8-4699-b170-6f18bff1781a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:13.967496 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-641d16a8-f1e8-4699-b170-6f18bff1781a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:13.968458 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-641d16a8-f1e8-4699-b170-6f18bff1781a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:13.969215 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-641d16a8-f1e8-4699-b170-6f18bff1781a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:14.056619 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-641d16a8-f1e8-4699-b170-6f18bff1781a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:14.068938 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-641d16a8-f1e8-4699-b170-6f18bff1781a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1603 microversion: 2.1 time: 0.112689 Aug 02 09:16:14.084882 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 310/628] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:13 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1603 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:14.248556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-e381f154-316c-449f-8fb7-9bca79e64cce tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "POST /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5/action" status: 202 len: 0 microversion: 2.20 time: 0.629604 Aug 02 09:16:14.249457 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 319/629] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Aug 2 09:16:13 2022] POST /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:16:14.258893 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-6867edd6-756d-462d-9973-4e1f9fdcb307 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:14.259780 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-6867edd6-756d-462d-9973-4e1f9fdcb307 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:14.266972 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6867edd6-756d-462d-9973-4e1f9fdcb307 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:14.267396 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6867edd6-756d-462d-9973-4e1f9fdcb307 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:14.268972 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6867edd6-756d-462d-9973-4e1f9fdcb307 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:14.269413 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6867edd6-756d-462d-9973-4e1f9fdcb307 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:14.433787 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-6867edd6-756d-462d-9973-4e1f9fdcb307 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:14.443219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-6867edd6-756d-462d-9973-4e1f9fdcb307 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:14.445714 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-6867edd6-756d-462d-9973-4e1f9fdcb307 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:14.447906 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-6867edd6-756d-462d-9973-4e1f9fdcb307 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1722 microversion: 2.20 time: 0.193382 Aug 02 09:16:14.448991 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 311/630] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:14 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:14.735846 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-f4a4d015-d1b8-4477-a656-60118253382d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:14.738569 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-f4a4d015-d1b8-4477-a656-60118253382d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:14.739907 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=3 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:14.746423 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f4a4d015-d1b8-4477-a656-60118253382d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:14.746954 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f4a4d015-d1b8-4477-a656-60118253382d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:14.747753 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f4a4d015-d1b8-4477-a656-60118253382d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:14.748231 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f4a4d015-d1b8-4477-a656-60118253382d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:14.895112 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-f4a4d015-d1b8-4477-a656-60118253382d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:14.897617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:14.904389 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-f4a4d015-d1b8-4477-a656-60118253382d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 200 len: 1682 microversion: 2.1 time: 0.173727 Aug 02 09:16:14.904978 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 320/631] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:14 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:14.978266 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-dbfef383-3c28-4856-9410-d4518d4783b4 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:14.978866 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-dbfef383-3c28-4856-9410-d4518d4783b4 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:14.985750 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-dbfef383-3c28-4856-9410-d4518d4783b4 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:14.986266 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-dbfef383-3c28-4856-9410-d4518d4783b4 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:14.988136 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-dbfef383-3c28-4856-9410-d4518d4783b4 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:14.988709 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-dbfef383-3c28-4856-9410-d4518d4783b4 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:15.092146 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-a138a694-a7e6-4d23-8c7e-82eb390a970c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:15.092814 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-a138a694-a7e6-4d23-8c7e-82eb390a970c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:15.102012 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a138a694-a7e6-4d23-8c7e-82eb390a970c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:15.102786 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a138a694-a7e6-4d23-8c7e-82eb390a970c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:15.103347 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a138a694-a7e6-4d23-8c7e-82eb390a970c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:15.103772 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a138a694-a7e6-4d23-8c7e-82eb390a970c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:15.148836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-dbfef383-3c28-4856-9410-d4518d4783b4 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:15.157141 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-dbfef383-3c28-4856-9410-d4518d4783b4 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1567 microversion: 2.1 time: 0.182784 Aug 02 09:16:15.157734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 312/632] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:14 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:15.184201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-a138a694-a7e6-4d23-8c7e-82eb390a970c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:15.193475 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-a138a694-a7e6-4d23-8c7e-82eb390a970c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 200 len: 1322 microversion: 2.1 time: 0.105356 Aug 02 09:16:15.194156 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 321/633] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:15 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 1322 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:15.474174 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c27611f0-d813-4e26-8fb5-84725bdf67aa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:15.478203 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-c27611f0-d813-4e26-8fb5-84725bdf67aa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:15.481780 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c27611f0-d813-4e26-8fb5-84725bdf67aa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:15.482233 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c27611f0-d813-4e26-8fb5-84725bdf67aa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:15.483057 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c27611f0-d813-4e26-8fb5-84725bdf67aa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:15.483500 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c27611f0-d813-4e26-8fb5-84725bdf67aa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:15.724627 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-c27611f0-d813-4e26-8fb5-84725bdf67aa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:15.733199 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-c27611f0-d813-4e26-8fb5-84725bdf67aa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:15.734676 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-c27611f0-d813-4e26-8fb5-84725bdf67aa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:15.735875 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-c27611f0-d813-4e26-8fb5-84725bdf67aa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1722 microversion: 2.20 time: 0.266461 Aug 02 09:16:15.736541 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 313/634] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:15 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:15.927769 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-06f32ba3-a4a9-411b-b77b-4208e6716000 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:15.928581 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-06f32ba3-a4a9-411b-b77b-4208e6716000 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:15.935718 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-06f32ba3-a4a9-411b-b77b-4208e6716000 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:15.936319 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-06f32ba3-a4a9-411b-b77b-4208e6716000 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:15.937018 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-06f32ba3-a4a9-411b-b77b-4208e6716000 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:15.937442 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-06f32ba3-a4a9-411b-b77b-4208e6716000 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:16.183920 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-17fd69b0-a58d-44d7-8786-a60c3935da44 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:16.184570 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-17fd69b0-a58d-44d7-8786-a60c3935da44 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:16.193161 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-17fd69b0-a58d-44d7-8786-a60c3935da44 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:16.193669 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-17fd69b0-a58d-44d7-8786-a60c3935da44 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:16.194415 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-17fd69b0-a58d-44d7-8786-a60c3935da44 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:16.195093 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-17fd69b0-a58d-44d7-8786-a60c3935da44 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:16.202913 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-06f32ba3-a4a9-411b-b77b-4208e6716000 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:16.213417 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-06f32ba3-a4a9-411b-b77b-4208e6716000 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 200 len: 1682 microversion: 2.1 time: 0.290622 Aug 02 09:16:16.214084 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 322/635] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:15 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 1682 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:16.228788 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-f044ddf1-103b-4411-a991-ffe3bf3d6f5c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:16.230021 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-f044ddf1-103b-4411-a991-ffe3bf3d6f5c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:16.243299 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f044ddf1-103b-4411-a991-ffe3bf3d6f5c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:16.244217 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f044ddf1-103b-4411-a991-ffe3bf3d6f5c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:16.245183 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f044ddf1-103b-4411-a991-ffe3bf3d6f5c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:16.245672 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f044ddf1-103b-4411-a991-ffe3bf3d6f5c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:16.265515 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-f044ddf1-103b-4411-a991-ffe3bf3d6f5c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] HTTP exception thrown: Instance 73c852c4-c5c3-4a1f-94b9-f6515a830bbb could not be found. Aug 02 09:16:16.267534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-f044ddf1-103b-4411-a991-ffe3bf3d6f5c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Request method failure captured: Aug 02 09:16:16.267534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb HTTP/1.1 Aug 02 09:16:16.267534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:16:16.267534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:16:16.267534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:16:16.267534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:16:16.267534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:16:16.267534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:16:16.267534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:16:16.267534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:16:16.267534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6OpsBR6h-Hh4LBg89etYcnHlHEfSnLo-qquyYn5hIv5GzaybSFvSkFeeQeiuO6eTSrHwoIsJQSkeHfU0Xu14EgDesftcfDgkuNBpFyG7LZ49WYHglfFft-eRdQuY3tvdcPoOuGiTV3AKukz4BkX7MM2qLdRCP_8VUArgzWtGq8k_Gyo Aug 02 09:16:16.267534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:16:16.267534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:16:16.267534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:16:16.267534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:16:16.267534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:16:16.267534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:16:16.267534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: 696f75fb6c494cfab9deb3d36c3ad599 Aug 02 09:16:16.267534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-AttachVolumeTestJSON-2016443108 Aug 02 09:16:16.267534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:16:16.267534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:16:16.270195 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/696f75fb6c494cfab9deb3d36c3ad599"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/696f75fb6c494cfab9deb3d36c3ad599"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/696f75fb6c494cfab9deb3d36c3ad599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_696f75fb6c494cfab9deb3d36c3ad599"}]}] Aug 02 09:16:16.270195 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-AttachVolumeTestJSON-2016443108 Aug 02 09:16:16.270195 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: 696f75fb6c494cfab9deb3d36c3ad599 Aug 02 09:16:16.270195 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2016443108 Aug 02 09:16:16.270195 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-AttachVolumeTestJSON-2016443108-project Aug 02 09:16:16.270195 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:16:16.270195 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:16:16.270195 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: 3bccd348dd13473e82ca33c42b840383 Aug 02 09:16:16.270195 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-AttachVolumeTestJSON-2016443108-project Aug 02 09:16:16.270195 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: > Aug 02 09:16:16.270195 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Instance 73c852c4-c5c3-4a1f-94b9-f6515a830bbb could not be found. Aug 02 09:16:16.270195 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': '73c852c4-c5c3-4a1f-94b9-f6515a830bbb'} Aug 02 09:16:16.271369 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:16:16.271369 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:16:16.271369 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:16:16.271369 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:16:16.271369 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:16:16.271369 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:16:16.271369 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:16:16.271369 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:16:16.271369 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:16:16.271369 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:16:16.271369 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73c852c4-c5c3-4a1f-94b9-f6515a830bbb could not be found. Aug 02 09:16:16.271369 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:16:16.271369 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:16:16.271369 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:16:16.271369 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:16:16.271369 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:16:16.271369 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:16:16.271369 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:16:16.271369 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:16:16.271369 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:16:16.273058 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:16:16.273058 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:16:16.273058 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:16:16.273058 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:16:16.273058 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:16:16.273058 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:16:16.273058 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:16:16.273058 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73c852c4-c5c3-4a1f-94b9-f6515a830bbb could not be found. Aug 02 09:16:16.273058 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:16:16.273058 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:16:16.273058 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:16:16.273058 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:16:16.273058 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:16:16.273058 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:16:16.273058 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:16:16.273058 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:16:16.273058 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73c852c4-c5c3-4a1f-94b9-f6515a830bbb could not be found. Aug 02 09:16:16.273058 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:16:16.276062 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-f044ddf1-103b-4411-a991-ffe3bf3d6f5c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Returning 404 to user: Instance 73c852c4-c5c3-4a1f-94b9-f6515a830bbb could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:16:16.277239 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-f044ddf1-103b-4411-a991-ffe3bf3d6f5c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 404 len: 111 microversion: 2.1 time: 0.057418 Aug 02 09:16:16.284372 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 323/636] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:16 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 09:16:16.295000 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-da3068e8-b74d-45e3-b5e2-5185c73669e6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '.version_select at 0x7ffb9aa4fb80>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:16.409517 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-da3068e8-b74d-45e3-b5e2-5185c73669e6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1690372796" status: 202 len: 0 microversion: 2.1 time: 0.121659 Aug 02 09:16:16.410742 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 324/637] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Aug 2 09:16:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1690372796 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:16:16.543488 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-17fd69b0-a58d-44d7-8786-a60c3935da44 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:16.557056 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=100 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:16.561186 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-17fd69b0-a58d-44d7-8786-a60c3935da44 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1567 microversion: 2.1 time: 0.380749 Aug 02 09:16:16.562657 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 314/638] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:16 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1567 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:16.779631 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-58377b9a-fd77-4068-a2ff-869390f8fb15 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:16.779631 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-58377b9a-fd77-4068-a2ff-869390f8fb15 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:16.820937 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-58377b9a-fd77-4068-a2ff-869390f8fb15 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:16.822440 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-58377b9a-fd77-4068-a2ff-869390f8fb15 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:16.824801 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-58377b9a-fd77-4068-a2ff-869390f8fb15 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:16.828479 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-58377b9a-fd77-4068-a2ff-869390f8fb15 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:17.243297 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-9adb6e64-e33b-4bbf-b826-9f2f1e78130a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:17.244711 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-9adb6e64-e33b-4bbf-b826-9f2f1e78130a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:17.260703 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9adb6e64-e33b-4bbf-b826-9f2f1e78130a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:17.263527 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9adb6e64-e33b-4bbf-b826-9f2f1e78130a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:17.264614 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9adb6e64-e33b-4bbf-b826-9f2f1e78130a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:17.265123 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9adb6e64-e33b-4bbf-b826-9f2f1e78130a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:17.483940 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-9adb6e64-e33b-4bbf-b826-9f2f1e78130a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:17.504122 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-9adb6e64-e33b-4bbf-b826-9f2f1e78130a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 200 len: 1615 microversion: 2.1 time: 0.268772 Aug 02 09:16:17.508130 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 315/639] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:17 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 1615 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:16:17.514135 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-70762db6-e598-4a3b-abd8-3a299da1c313 req-e5821519-efaa-4723-926d-1fc7d183a82c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0331a7cf-074f-4e27-b452-e057f9b422c5", "name": "network-vif-deleted", "tag": "a3478fbe-d4f8-4edb-bd8f-4af63ca7a8d1"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:17.533100 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-70762db6-e598-4a3b-abd8-3a299da1c313 req-e5821519-efaa-4723-926d-1fc7d183a82c service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:17.534794 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-70762db6-e598-4a3b-abd8-3a299da1c313 req-e5821519-efaa-4723-926d-1fc7d183a82c service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:17.545846 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-58377b9a-fd77-4068-a2ff-869390f8fb15 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:17.573448 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-70762db6-e598-4a3b-abd8-3a299da1c313 req-e5821519-efaa-4723-926d-1fc7d183a82c service nova] Creating event network-vif-deleted:a3478fbe-d4f8-4edb-bd8f-4af63ca7a8d1 for instance 0331a7cf-074f-4e27-b452-e057f9b422c5 on hv-cinder-84599 Aug 02 09:16:17.576322 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-58377b9a-fd77-4068-a2ff-869390f8fb15 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:17.578135 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-58377b9a-fd77-4068-a2ff-869390f8fb15 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:17.579934 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-58377b9a-fd77-4068-a2ff-869390f8fb15 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1722 microversion: 2.20 time: 0.819835 Aug 02 09:16:17.581661 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 325/640] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:16 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1722 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:17.587610 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ce115d0d-a664-4dc9-a2fc-60f89b2dee86 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:17.588585 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ce115d0d-a664-4dc9-a2fc-60f89b2dee86 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:17.598216 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ce115d0d-a664-4dc9-a2fc-60f89b2dee86 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:17.598947 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ce115d0d-a664-4dc9-a2fc-60f89b2dee86 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:17.599522 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-70762db6-e598-4a3b-abd8-3a299da1c313 req-e5821519-efaa-4723-926d-1fc7d183a82c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086441 Aug 02 09:16:17.600425 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ce115d0d-a664-4dc9-a2fc-60f89b2dee86 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:17.600877 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ce115d0d-a664-4dc9-a2fc-60f89b2dee86 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:17.606461 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 316/641] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:17.806193 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ce115d0d-a664-4dc9-a2fc-60f89b2dee86 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:17.815265 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ce115d0d-a664-4dc9-a2fc-60f89b2dee86 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1567 microversion: 2.1 time: 0.231831 Aug 02 09:16:17.816151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 326/642] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:17 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1567 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:18.051828 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-594b9208-a988-4fa2-a207-85fe69b1ed5a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Action: 'create', calling method: .version_select at 0x7ffb9aa72e50>, body: {"keypair": {"name": "tempest-keypair-955082367", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZ3ivjDUvSX/28x3H2Nd4S+Gq2S9iEHR2swd3N0y2dX/Ton2ag0zZcpwc9Z0QAdc5ILiDnkOwaLrTXem6EvWKubjni3stPC9sG8HMvskToKP14G1T0unzRz5uHyWT5S+g=="}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:18.072504 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-594b9208-a988-4fa2-a207-85fe69b1ed5a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Getting quotas for project 696f75fb6c494cfab9deb3d36c3ad599. Resources: {'key_pairs'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:16:18.079097 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-594b9208-a988-4fa2-a207-85fe69b1ed5a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Getting quotas for user 3bccd348dd13473e82ca33c42b840383 and project 696f75fb6c494cfab9deb3d36c3ad599. Resources: {'key_pairs'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:16:18.253685 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-594b9208-a988-4fa2-a207-85fe69b1ed5a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.210021 Aug 02 09:16:18.254288 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 317/643] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 2 09:16:18 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:16:18.527472 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-13728241-4ce2-404e-8721-11478a57cd43 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:18.528183 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-13728241-4ce2-404e-8721-11478a57cd43 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:18.535180 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-13728241-4ce2-404e-8721-11478a57cd43 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:18.545576 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-13728241-4ce2-404e-8721-11478a57cd43 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:18.545576 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-13728241-4ce2-404e-8721-11478a57cd43 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:18.545576 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-13728241-4ce2-404e-8721-11478a57cd43 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:18.569611 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-13728241-4ce2-404e-8721-11478a57cd43 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:18.570160 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-13728241-4ce2-404e-8721-11478a57cd43 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:18.570495 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.objects.instance [None req-13728241-4ce2-404e-8721-11478a57cd43 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lazy-loading 'fault' on Instance uuid 0331a7cf-074f-4e27-b452-e057f9b422c5 {{(pid=118525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:16:18.609308 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-6da0abd3-c671-47c2-92ef-7860fdd0f0a1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:18.612089 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-6da0abd3-c671-47c2-92ef-7860fdd0f0a1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:18.617793 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-13728241-4ce2-404e-8721-11478a57cd43 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:18.617975 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6da0abd3-c671-47c2-92ef-7860fdd0f0a1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:18.618252 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6da0abd3-c671-47c2-92ef-7860fdd0f0a1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:18.619123 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6da0abd3-c671-47c2-92ef-7860fdd0f0a1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:18.619463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6da0abd3-c671-47c2-92ef-7860fdd0f0a1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:18.626140 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-13728241-4ce2-404e-8721-11478a57cd43 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 200 len: 1332 microversion: 2.1 time: 0.102334 Aug 02 09:16:18.626727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 327/644] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:18 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:18.786242 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-6da0abd3-c671-47c2-92ef-7860fdd0f0a1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:18.794607 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-6da0abd3-c671-47c2-92ef-7860fdd0f0a1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:18.796110 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-6da0abd3-c671-47c2-92ef-7860fdd0f0a1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:18.797329 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-6da0abd3-c671-47c2-92ef-7860fdd0f0a1 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1722 microversion: 2.20 time: 0.193254 Aug 02 09:16:18.797883 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 318/645] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:18 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:16:18.837552 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-090e6829-e973-45be-aa01-07f6e12c72a2 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:18.838157 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-090e6829-e973-45be-aa01-07f6e12c72a2 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:18.844577 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-090e6829-e973-45be-aa01-07f6e12c72a2 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:18.845921 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-090e6829-e973-45be-aa01-07f6e12c72a2 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:18.845921 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-090e6829-e973-45be-aa01-07f6e12c72a2 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:18.846507 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-090e6829-e973-45be-aa01-07f6e12c72a2 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:18.992371 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-090e6829-e973-45be-aa01-07f6e12c72a2 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:19.006326 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-090e6829-e973-45be-aa01-07f6e12c72a2 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1567 microversion: 2.1 time: 0.172186 Aug 02 09:16:19.007305 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 328/646] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:18 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:19.659967 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-1c46584f-f95f-4987-87ed-be898072d8be tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:19.660996 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-1c46584f-f95f-4987-87ed-be898072d8be tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:19.673137 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1c46584f-f95f-4987-87ed-be898072d8be tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:19.673137 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1c46584f-f95f-4987-87ed-be898072d8be tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:19.673137 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1c46584f-f95f-4987-87ed-be898072d8be tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:19.673137 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1c46584f-f95f-4987-87ed-be898072d8be tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:19.707015 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1c46584f-f95f-4987-87ed-be898072d8be tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:19.708100 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1c46584f-f95f-4987-87ed-be898072d8be tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:19.708611 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.objects.instance [None req-1c46584f-f95f-4987-87ed-be898072d8be tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lazy-loading 'fault' on Instance uuid 0331a7cf-074f-4e27-b452-e057f9b422c5 {{(pid=118526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:16:19.753443 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-1c46584f-f95f-4987-87ed-be898072d8be tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:19.761350 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-1c46584f-f95f-4987-87ed-be898072d8be tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 200 len: 1332 microversion: 2.1 time: 0.106502 Aug 02 09:16:19.761932 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 319/647] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:19 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:19.822130 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d077c0a3-92af-4e2f-b573-45587a741e35 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:19.822750 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-d077c0a3-92af-4e2f-b573-45587a741e35 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:19.833989 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d077c0a3-92af-4e2f-b573-45587a741e35 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:19.833989 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d077c0a3-92af-4e2f-b573-45587a741e35 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:19.833989 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d077c0a3-92af-4e2f-b573-45587a741e35 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:19.833989 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d077c0a3-92af-4e2f-b573-45587a741e35 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:19.994098 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d077c0a3-92af-4e2f-b573-45587a741e35 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:20.002139 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d077c0a3-92af-4e2f-b573-45587a741e35 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:20.004365 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d077c0a3-92af-4e2f-b573-45587a741e35 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:20.005592 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-d077c0a3-92af-4e2f-b573-45587a741e35 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1722 microversion: 2.20 time: 0.187680 Aug 02 09:16:20.006132 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 329/648] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:19 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:20.040686 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-01c9c3f4-1377-49c5-8bcc-2c9164155058 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:20.045597 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-01c9c3f4-1377-49c5-8bcc-2c9164155058 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:20.047622 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-01c9c3f4-1377-49c5-8bcc-2c9164155058 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:20.048074 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-01c9c3f4-1377-49c5-8bcc-2c9164155058 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:20.048909 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-01c9c3f4-1377-49c5-8bcc-2c9164155058 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:20.049976 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-01c9c3f4-1377-49c5-8bcc-2c9164155058 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:20.205755 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-01c9c3f4-1377-49c5-8bcc-2c9164155058 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:20.213919 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-01c9c3f4-1377-49c5-8bcc-2c9164155058 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1567 microversion: 2.1 time: 0.177184 Aug 02 09:16:20.214587 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 320/649] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:20 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1567 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:20.785817 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-c7e37740-4055-4f33-9b42-837c89e0e7c1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:20.785817 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-c7e37740-4055-4f33-9b42-837c89e0e7c1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:20.792558 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c7e37740-4055-4f33-9b42-837c89e0e7c1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:20.793073 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c7e37740-4055-4f33-9b42-837c89e0e7c1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:20.793928 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c7e37740-4055-4f33-9b42-837c89e0e7c1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:20.794427 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c7e37740-4055-4f33-9b42-837c89e0e7c1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:20.807851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-c7e37740-4055-4f33-9b42-837c89e0e7c1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] HTTP exception thrown: Instance 0331a7cf-074f-4e27-b452-e057f9b422c5 could not be found. Aug 02 09:16:20.809486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-c7e37740-4055-4f33-9b42-837c89e0e7c1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Request method failure captured: Aug 02 09:16:20.809486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 HTTP/1.1 Aug 02 09:16:20.809486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:16:20.809486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:16:20.809486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:16:20.809486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:16:20.809486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:16:20.809486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:16:20.809486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:16:20.809486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:16:20.809486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6OoKOsXfjNTp1mjsj6r1IgBAgQBzTLiQjJO0bR1TldRTpxWx6tSFZWanW3Gv02s-EY-9kVRC92iBnbzPS2ztWMdgardIrvDP60IsZABewH2eMK4dXX1f7Hpv6gsaQwPQ8jW613IMovFbfYZIhNfO_yD-aTLWmHXV3Hwct_s6HofR820 Aug 02 09:16:20.809486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:16:20.809486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:16:20.809486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:16:20.809486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:16:20.809486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:16:20.809486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:16:20.809486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:16:20.809486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:16:20.809486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:16:20.809486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:16:20.817038 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6fc6b07497a48eeb263b3a9b8aa7499"}]}] Aug 02 09:16:20.817038 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:16:20.817038 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:16:20.817038 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:16:20.817038 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:16:20.817038 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:16:20.817038 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:16:20.817038 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: ad3a9141e9284bb5a096fb04d3e9d581 Aug 02 09:16:20.817038 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:16:20.817038 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: > Aug 02 09:16:20.817038 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Instance 0331a7cf-074f-4e27-b452-e057f9b422c5 could not be found. Aug 02 09:16:20.817038 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': '0331a7cf-074f-4e27-b452-e057f9b422c5'} Aug 02 09:16:20.817999 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:16:20.817999 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:16:20.817999 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:16:20.817999 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:16:20.817999 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:16:20.817999 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:16:20.817999 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:16:20.817999 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:16:20.817999 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:16:20.817999 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:16:20.817999 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0331a7cf-074f-4e27-b452-e057f9b422c5 could not be found. Aug 02 09:16:20.817999 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:16:20.817999 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:16:20.817999 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:16:20.817999 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:16:20.817999 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:16:20.817999 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:16:20.817999 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:16:20.817999 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:16:20.817999 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:16:20.819413 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:16:20.819413 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:16:20.819413 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:16:20.819413 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:16:20.819413 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:16:20.819413 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:16:20.819413 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:16:20.819413 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0331a7cf-074f-4e27-b452-e057f9b422c5 could not be found. Aug 02 09:16:20.819413 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:16:20.819413 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:16:20.819413 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:16:20.819413 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:16:20.819413 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:16:20.819413 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:16:20.819413 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:16:20.819413 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:16:20.819413 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0331a7cf-074f-4e27-b452-e057f9b422c5 could not be found. Aug 02 09:16:20.819413 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:16:20.820770 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-c7e37740-4055-4f33-9b42-837c89e0e7c1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Returning 404 to user: Instance 0331a7cf-074f-4e27-b452-e057f9b422c5 could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:16:20.820770 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-c7e37740-4055-4f33-9b42-837c89e0e7c1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 404 len: 111 microversion: 2.1 time: 0.030604 Aug 02 09:16:20.820770 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 330/650] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:20 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:16:20.827183 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-5c259fdc-dfa0-4059-aab9-9652c5d90659 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '.version_select at 0x7ffb9aa6f8b0>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:20.922049 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-5c259fdc-dfa0-4059-aab9-9652c5d90659 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1074134632" status: 202 len: 0 microversion: 2.1 time: 0.099166 Aug 02 09:16:20.922659 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 321/651] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Aug 2 09:16:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1074134632 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:16:21.029958 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-78d4b9f7-60ca-486f-9bd9-2165fa0fb721 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:21.030828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-78d4b9f7-60ca-486f-9bd9-2165fa0fb721 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:21.038193 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-78d4b9f7-60ca-486f-9bd9-2165fa0fb721 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:21.038558 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-78d4b9f7-60ca-486f-9bd9-2165fa0fb721 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:21.039556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-78d4b9f7-60ca-486f-9bd9-2165fa0fb721 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:21.039992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-78d4b9f7-60ca-486f-9bd9-2165fa0fb721 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:21.077493 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c4ad6d3e-696c-4241-8bf1-1887a3e464e7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1366224266", "imageRef": "7a52f4c5-c531-494a-b375-4f6dce3abbc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab237ada-006b-4bfa-8c12-da09c8cbc0dd"}], "security_groups": [{"name": "tempest-securitygroup--2041509678"}], "key_name": "tempest-keypair-955082367", "user_data": "}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:21.278966 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.network.neutron [None req-c4ad6d3e-696c-4241-8bf1-1887a3e464e7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] validate_networks() for [('ab237ada-006b-4bfa-8c12-da09c8cbc0dd', None, None, None, None, None)] {{(pid=118526) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:16:21.283619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-78d4b9f7-60ca-486f-9bd9-2165fa0fb721 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:21.297757 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-78d4b9f7-60ca-486f-9bd9-2165fa0fb721 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:21.300174 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-78d4b9f7-60ca-486f-9bd9-2165fa0fb721 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:21.305641 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-78d4b9f7-60ca-486f-9bd9-2165fa0fb721 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1722 microversion: 2.20 time: 0.279487 Aug 02 09:16:21.306293 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 331/652] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:21 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1722 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:21.322534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-81fa5405-af4b-43b6-aaf1-26a75958b722 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:21.322534 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-81fa5405-af4b-43b6-aaf1-26a75958b722 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:21.338555 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-81fa5405-af4b-43b6-aaf1-26a75958b722 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:21.340233 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-81fa5405-af4b-43b6-aaf1-26a75958b722 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:21.340233 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-81fa5405-af4b-43b6-aaf1-26a75958b722 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:21.340418 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-81fa5405-af4b-43b6-aaf1-26a75958b722 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:21.586220 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-81fa5405-af4b-43b6-aaf1-26a75958b722 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:21.594804 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-81fa5405-af4b-43b6-aaf1-26a75958b722 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1568 microversion: 2.1 time: 0.287417 Aug 02 09:16:21.595566 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 332/653] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:21 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1568 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:21.617123 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-cd6fe34c-9698-44f4-9521-37e0e42f56cf tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:21.618025 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-cd6fe34c-9698-44f4-9521-37e0e42f56cf tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:21.624462 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cd6fe34c-9698-44f4-9521-37e0e42f56cf tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:21.625217 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cd6fe34c-9698-44f4-9521-37e0e42f56cf tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:21.626954 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cd6fe34c-9698-44f4-9521-37e0e42f56cf tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:21.626954 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cd6fe34c-9698-44f4-9521-37e0e42f56cf tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:21.658705 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-cd6fe34c-9698-44f4-9521-37e0e42f56cf tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118525) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 09:16:21.938378 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-c4ad6d3e-696c-4241-8bf1-1887a3e464e7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Flavor limits 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:16:21.939614 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-c4ad6d3e-696c-4241-8bf1-1887a3e464e7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Image limits 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:16:21.940906 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-c4ad6d3e-696c-4241-8bf1-1887a3e464e7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Flavor pref 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:16:21.941359 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-c4ad6d3e-696c-4241-8bf1-1887a3e464e7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Image pref 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:16:21.941774 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-c4ad6d3e-696c-4241-8bf1-1887a3e464e7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:16:21.951672 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c4ad6d3e-696c-4241-8bf1-1887a3e464e7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:21.952250 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c4ad6d3e-696c-4241-8bf1-1887a3e464e7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:21.952990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c4ad6d3e-696c-4241-8bf1-1887a3e464e7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:21.953427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c4ad6d3e-696c-4241-8bf1-1887a3e464e7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:21.970734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-c4ad6d3e-696c-4241-8bf1-1887a3e464e7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Getting quotas for project 696f75fb6c494cfab9deb3d36c3ad599. Resources: {'cores', 'ram', 'instances'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:16:21.975831 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-c4ad6d3e-696c-4241-8bf1-1887a3e464e7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Getting quotas for user 3bccd348dd13473e82ca33c42b840383 and project 696f75fb6c494cfab9deb3d36c3ad599. Resources: {'cores', 'ram', 'instances'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:16:21.987819 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-c4ad6d3e-696c-4241-8bf1-1887a3e464e7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Going to run 1 instances... {{(pid=118526) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:16:21.990153 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-c4ad6d3e-696c-4241-8bf1-1887a3e464e7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7a52f4c5-c531-494a-b375-4f6dce3abbc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:16:22.073871 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-cd6fe34c-9698-44f4-9521-37e0e42f56cf tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "POST /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577/action" status: 202 len: 0 microversion: 2.1 time: 0.460932 Aug 02 09:16:22.075055 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 333/654] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 2 09:16:21 2022] POST /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 09:16:22.080050 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-71d8e05e-0745-4c2a-b6c8-95422267f7a3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Action: 'create', calling method: .version_select at 0x7ffb9aa279d0>, body: {"keypair": {"name": "tempest-keypair-130336248", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHgan6RRMLOFOyacb9qU8sKdRTct9zcOxR6RKmtjK3kwZkQ6Glp+De//NAZDvv756XZzAPtl4PpiT/qGeIsVLOILPTK+4exOo90Q7aZMA1Prk7jcSTl4xuKY+THgFUbbVg=="}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:22.103862 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-71d8e05e-0745-4c2a-b6c8-95422267f7a3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Getting quotas for project b6fc6b07497a48eeb263b3a9b8aa7499. Resources: {'key_pairs'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:16:22.106523 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-c4ad6d3e-696c-4241-8bf1-1887a3e464e7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.033515 Aug 02 09:16:22.109599 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-71d8e05e-0745-4c2a-b6c8-95422267f7a3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Getting quotas for user ad3a9141e9284bb5a096fb04d3e9d581 and project b6fc6b07497a48eeb263b3a9b8aa7499. Resources: {'key_pairs'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:16:22.113317 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 322/655] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 2 09:16:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 1041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 09:16:22.118193 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-53037c39-e79a-46e2-a580-a1c9f7e3bcb5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:22.118864 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-53037c39-e79a-46e2-a580-a1c9f7e3bcb5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:22.120864 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:22.126738 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-53037c39-e79a-46e2-a580-a1c9f7e3bcb5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:22.128354 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-53037c39-e79a-46e2-a580-a1c9f7e3bcb5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:22.130182 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-53037c39-e79a-46e2-a580-a1c9f7e3bcb5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:22.130537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-53037c39-e79a-46e2-a580-a1c9f7e3bcb5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:22.209632 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-71d8e05e-0745-4c2a-b6c8-95422267f7a3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.133497 Aug 02 09:16:22.217272 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 334/656] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 2 09:16:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:22.226053 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-82fbc64e-b90a-455d-a270-fbc6ee1b6d41 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:22.226983 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-82fbc64e-b90a-455d-a270-fbc6ee1b6d41 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:22.309047 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-82fbc64e-b90a-455d-a270-fbc6ee1b6d41 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:22.320181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-82fbc64e-b90a-455d-a270-fbc6ee1b6d41 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be" status: 200 len: 1237 microversion: 2.1 time: 0.101089 Aug 02 09:16:22.323961 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 335/657] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:22 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be => generated 1237 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:22.336005 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-2a1372b4-5aa2-4d13-8227-b59c69074068 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:22.337076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-2a1372b4-5aa2-4d13-8227-b59c69074068 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:22.346750 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2a1372b4-5aa2-4d13-8227-b59c69074068 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:22.347391 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2a1372b4-5aa2-4d13-8227-b59c69074068 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:22.348674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2a1372b4-5aa2-4d13-8227-b59c69074068 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:22.349114 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2a1372b4-5aa2-4d13-8227-b59c69074068 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:22.356977 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-53037c39-e79a-46e2-a580-a1c9f7e3bcb5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:22.366937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-53037c39-e79a-46e2-a580-a1c9f7e3bcb5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1516 microversion: 2.1 time: 0.252483 Aug 02 09:16:22.368286 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 323/658] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:22 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1516 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:22.588437 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-2a1372b4-5aa2-4d13-8227-b59c69074068 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:22.598851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-2a1372b4-5aa2-4d13-8227-b59c69074068 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:22.600420 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-2a1372b4-5aa2-4d13-8227-b59c69074068 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:22.601827 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-2a1372b4-5aa2-4d13-8227-b59c69074068 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1722 microversion: 2.20 time: 0.271929 Aug 02 09:16:22.602730 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 336/659] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:22 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:23.341830 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-1dbcb83c-345b-4428-8b9f-086db839b244 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:23.343067 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-1dbcb83c-345b-4428-8b9f-086db839b244 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:23.389614 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d6943dc8-c3db-4bbb-a242-59eccfc5091a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:23.390224 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-d6943dc8-c3db-4bbb-a242-59eccfc5091a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:23.397933 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d6943dc8-c3db-4bbb-a242-59eccfc5091a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:23.398192 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d6943dc8-c3db-4bbb-a242-59eccfc5091a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:23.399005 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d6943dc8-c3db-4bbb-a242-59eccfc5091a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:23.399433 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d6943dc8-c3db-4bbb-a242-59eccfc5091a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:23.400508 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-1dbcb83c-345b-4428-8b9f-086db839b244 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:23.407674 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-1dbcb83c-345b-4428-8b9f-086db839b244 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be" status: 200 len: 1237 microversion: 2.1 time: 0.069998 Aug 02 09:16:23.408469 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 324/660] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:23 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:23.582631 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d6943dc8-c3db-4bbb-a242-59eccfc5091a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:23.590833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-d6943dc8-c3db-4bbb-a242-59eccfc5091a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1516 microversion: 2.1 time: 0.204972 Aug 02 09:16:23.591460 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 337/661] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:23 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1516 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:23.625804 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-4a3adccb-be49-4974-a1dd-ab305c5b422c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:23.626662 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-4a3adccb-be49-4974-a1dd-ab305c5b422c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:23.633280 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4a3adccb-be49-4974-a1dd-ab305c5b422c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:23.633725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4a3adccb-be49-4974-a1dd-ab305c5b422c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:23.634490 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4a3adccb-be49-4974-a1dd-ab305c5b422c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:23.634922 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4a3adccb-be49-4974-a1dd-ab305c5b422c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:23.807287 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-4a3adccb-be49-4974-a1dd-ab305c5b422c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:23.815754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-eea8c1f7-ef3c-4a5a-95ca-5f0130c6dc76 req-59180106-c330-4b54-a4ea-3a4beaa0ae46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c36b6524-980c-4f56-b1ad-e71536c08577", "name": "network-vif-unplugged", "status": "completed", "tag": "541f0637-de44-45f3-b1dd-7b7924d55993"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:23.817063 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-4a3adccb-be49-4974-a1dd-ab305c5b422c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:23.818586 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-4a3adccb-be49-4974-a1dd-ab305c5b422c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:23.826304 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-4a3adccb-be49-4974-a1dd-ab305c5b422c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1722 microversion: 2.20 time: 0.197965 Aug 02 09:16:23.826304 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 325/662] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:23 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:23.826581 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-eea8c1f7-ef3c-4a5a-95ca-5f0130c6dc76 req-59180106-c330-4b54-a4ea-3a4beaa0ae46 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:23.826964 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-eea8c1f7-ef3c-4a5a-95ca-5f0130c6dc76 req-59180106-c330-4b54-a4ea-3a4beaa0ae46 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:23.839479 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.compute.server_external_events [req-eea8c1f7-ef3c-4a5a-95ca-5f0130c6dc76 req-59180106-c330-4b54-a4ea-3a4beaa0ae46 service nova] Unable to find a host for instance c36b6524-980c-4f56-b1ad-e71536c08577. Dropping event network-vif-unplugged {{(pid=118525) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 02 09:16:23.840397 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-eea8c1f7-ef3c-4a5a-95ca-5f0130c6dc76 req-59180106-c330-4b54-a4ea-3a4beaa0ae46 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.139067 Aug 02 09:16:23.840992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 338/663] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 140 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 02 09:16:24.439413 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-52962da0-1bd1-44fc-b263-9f156c60ea08 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:24.440503 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-52962da0-1bd1-44fc-b263-9f156c60ea08 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:24.449683 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-52962da0-1bd1-44fc-b263-9f156c60ea08 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:24.450260 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-52962da0-1bd1-44fc-b263-9f156c60ea08 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:24.451107 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-52962da0-1bd1-44fc-b263-9f156c60ea08 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:24.451599 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-52962da0-1bd1-44fc-b263-9f156c60ea08 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:24.523051 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-52962da0-1bd1-44fc-b263-9f156c60ea08 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:24.531687 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-52962da0-1bd1-44fc-b263-9f156c60ea08 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be" status: 200 len: 1289 microversion: 2.1 time: 0.104462 Aug 02 09:16:24.532313 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 326/664] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:24 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be => generated 1289 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:24.622114 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-c1185ffe-73b5-4322-9872-2eea5117cb7f tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:24.622844 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-c1185ffe-73b5-4322-9872-2eea5117cb7f tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:24.631320 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c1185ffe-73b5-4322-9872-2eea5117cb7f tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:24.631868 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c1185ffe-73b5-4322-9872-2eea5117cb7f tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:24.633498 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c1185ffe-73b5-4322-9872-2eea5117cb7f tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:24.634108 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c1185ffe-73b5-4322-9872-2eea5117cb7f tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:24.815874 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-c1185ffe-73b5-4322-9872-2eea5117cb7f tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:24.824025 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-c1185ffe-73b5-4322-9872-2eea5117cb7f tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1518 microversion: 2.1 time: 0.206143 Aug 02 09:16:24.824946 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 339/665] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:24 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1518 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:24.848472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-f6c3a63e-0123-4b1c-8e17-3e6830e719d2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:24.849292 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-f6c3a63e-0123-4b1c-8e17-3e6830e719d2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:24.855473 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f6c3a63e-0123-4b1c-8e17-3e6830e719d2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:24.855922 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f6c3a63e-0123-4b1c-8e17-3e6830e719d2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:24.857220 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f6c3a63e-0123-4b1c-8e17-3e6830e719d2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:24.857663 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f6c3a63e-0123-4b1c-8e17-3e6830e719d2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:25.103562 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-f6c3a63e-0123-4b1c-8e17-3e6830e719d2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:25.112608 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-f6c3a63e-0123-4b1c-8e17-3e6830e719d2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:25.114284 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-f6c3a63e-0123-4b1c-8e17-3e6830e719d2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:25.115708 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-f6c3a63e-0123-4b1c-8e17-3e6830e719d2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1722 microversion: 2.20 time: 0.271723 Aug 02 09:16:25.116285 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 327/666] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:24 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1722 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:16:25.554496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-13c355c2-6a4c-4b9b-8bec-3139cf03a01d tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:25.557472 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-13c355c2-6a4c-4b9b-8bec-3139cf03a01d tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:25.562112 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-13c355c2-6a4c-4b9b-8bec-3139cf03a01d tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:25.562398 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-13c355c2-6a4c-4b9b-8bec-3139cf03a01d tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:25.563191 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-13c355c2-6a4c-4b9b-8bec-3139cf03a01d tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:25.563625 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-13c355c2-6a4c-4b9b-8bec-3139cf03a01d tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:25.653352 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-13c355c2-6a4c-4b9b-8bec-3139cf03a01d tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:25.662209 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-13c355c2-6a4c-4b9b-8bec-3139cf03a01d tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be" status: 200 len: 1307 microversion: 2.1 time: 0.111621 Aug 02 09:16:25.662962 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 340/667] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:25 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be => generated 1307 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:16:25.788677 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-80f801bc-6c28-4701-b1d4-ad83dc6d8ef0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-828111628", "imageRef": "7a52f4c5-c531-494a-b375-4f6dce3abbc2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "51ed4955-009d-4088-8f3a-112c98fc8362"}], "security_groups": [{"name": "tempest-securitygroup--808617499"}], "key_name": "tempest-keypair-130336248", "user_data": "}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:25.849073 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-50dce95e-a884-4255-8a66-89f2bc54a1b0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:25.850084 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-50dce95e-a884-4255-8a66-89f2bc54a1b0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:25.857636 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-50dce95e-a884-4255-8a66-89f2bc54a1b0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:25.858527 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-50dce95e-a884-4255-8a66-89f2bc54a1b0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:25.859487 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-50dce95e-a884-4255-8a66-89f2bc54a1b0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:25.860260 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-50dce95e-a884-4255-8a66-89f2bc54a1b0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:25.865207 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:25.991197 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.network.neutron [None req-80f801bc-6c28-4701-b1d4-ad83dc6d8ef0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] validate_networks() for [('51ed4955-009d-4088-8f3a-112c98fc8362', None, None, None, None, None)] {{(pid=118526) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:16:26.155932 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-50dce95e-a884-4255-8a66-89f2bc54a1b0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:26.165899 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-50dce95e-a884-4255-8a66-89f2bc54a1b0 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1574 microversion: 2.1 time: 0.322164 Aug 02 09:16:26.166650 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 341/668] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:25 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1574 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:16:26.195624 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-3c4d29a0-05ee-41f9-815d-5ad3deea2e9c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:26.196542 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-3c4d29a0-05ee-41f9-815d-5ad3deea2e9c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:26.204850 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3c4d29a0-05ee-41f9-815d-5ad3deea2e9c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:26.205965 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3c4d29a0-05ee-41f9-815d-5ad3deea2e9c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:26.209773 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3c4d29a0-05ee-41f9-815d-5ad3deea2e9c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:26.210348 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3c4d29a0-05ee-41f9-815d-5ad3deea2e9c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:26.603576 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-3c4d29a0-05ee-41f9-815d-5ad3deea2e9c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:26.615445 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-3c4d29a0-05ee-41f9-815d-5ad3deea2e9c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:26.617054 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-3c4d29a0-05ee-41f9-815d-5ad3deea2e9c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:26.618280 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-3c4d29a0-05ee-41f9-815d-5ad3deea2e9c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1722 microversion: 2.20 time: 0.450463 Aug 02 09:16:26.618856 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 342/669] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:26 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1722 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:26.687273 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-243bb68e-38d5-4c99-96e5-2bed24d082a4 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:26.688186 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-243bb68e-38d5-4c99-96e5-2bed24d082a4 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:26.696311 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-243bb68e-38d5-4c99-96e5-2bed24d082a4 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:26.696763 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-243bb68e-38d5-4c99-96e5-2bed24d082a4 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:26.697800 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-243bb68e-38d5-4c99-96e5-2bed24d082a4 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:26.698286 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-243bb68e-38d5-4c99-96e5-2bed24d082a4 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:27.340346 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-243bb68e-38d5-4c99-96e5-2bed24d082a4 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:27.350033 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-243bb68e-38d5-4c99-96e5-2bed24d082a4 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be" status: 200 len: 1363 microversion: 2.1 time: 0.668322 Aug 02 09:16:27.351214 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 343/670] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:26 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be => generated 1363 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:16:27.356520 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-a2cfe8e9-af8c-43e9-bb6d-b210cbefb8e5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:27.357462 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-a2cfe8e9-af8c-43e9-bb6d-b210cbefb8e5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:27.369505 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a2cfe8e9-af8c-43e9-bb6d-b210cbefb8e5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:27.370303 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a2cfe8e9-af8c-43e9-bb6d-b210cbefb8e5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:27.371303 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a2cfe8e9-af8c-43e9-bb6d-b210cbefb8e5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:27.371935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a2cfe8e9-af8c-43e9-bb6d-b210cbefb8e5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:27.442047 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-80f801bc-6c28-4701-b1d4-ad83dc6d8ef0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Flavor limits 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:16:27.442847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-80f801bc-6c28-4701-b1d4-ad83dc6d8ef0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Image limits 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:16:27.443034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-80f801bc-6c28-4701-b1d4-ad83dc6d8ef0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Flavor pref 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:16:27.449429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-80f801bc-6c28-4701-b1d4-ad83dc6d8ef0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Image pref 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:16:27.449988 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-80f801bc-6c28-4701-b1d4-ad83dc6d8ef0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:16:27.465389 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-80f801bc-6c28-4701-b1d4-ad83dc6d8ef0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:27.470713 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-80f801bc-6c28-4701-b1d4-ad83dc6d8ef0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:27.470713 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-80f801bc-6c28-4701-b1d4-ad83dc6d8ef0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:27.470713 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-80f801bc-6c28-4701-b1d4-ad83dc6d8ef0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:27.485854 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-80f801bc-6c28-4701-b1d4-ad83dc6d8ef0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Getting quotas for project b6fc6b07497a48eeb263b3a9b8aa7499. Resources: {'cores', 'ram', 'instances'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:16:27.500565 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-80f801bc-6c28-4701-b1d4-ad83dc6d8ef0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Getting quotas for user ad3a9141e9284bb5a096fb04d3e9d581 and project b6fc6b07497a48eeb263b3a9b8aa7499. Resources: {'cores', 'ram', 'instances'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:16:27.516609 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-80f801bc-6c28-4701-b1d4-ad83dc6d8ef0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Going to run 1 instances... {{(pid=118526) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:16:27.519579 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-80f801bc-6c28-4701-b1d4-ad83dc6d8ef0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7a52f4c5-c531-494a-b375-4f6dce3abbc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:16:27.655584 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-80f801bc-6c28-4701-b1d4-ad83dc6d8ef0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.872145 Aug 02 09:16:27.656522 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 328/671] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 2 09:16:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 1874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:16:27.661784 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-ea00f28a-6e0f-4a8b-bf80-e58a7270a6f7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:27.662683 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-ea00f28a-6e0f-4a8b-bf80-e58a7270a6f7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:27.673448 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ea00f28a-6e0f-4a8b-bf80-e58a7270a6f7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:27.674269 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ea00f28a-6e0f-4a8b-bf80-e58a7270a6f7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:27.675686 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ea00f28a-6e0f-4a8b-bf80-e58a7270a6f7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:27.676509 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ea00f28a-6e0f-4a8b-bf80-e58a7270a6f7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:27.786312 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-a2cfe8e9-af8c-43e9-bb6d-b210cbefb8e5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:27.796908 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-a2cfe8e9-af8c-43e9-bb6d-b210cbefb8e5 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1574 microversion: 2.1 time: 0.444302 Aug 02 09:16:27.797823 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 344/672] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:27 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1574 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:27.803770 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4f33950a-ad07-4777-9641-a62d21f558c1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:27.804884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-4f33950a-ad07-4777-9641-a62d21f558c1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:27.996482 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-4f33950a-ad07-4777-9641-a62d21f558c1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:28.001986 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-4f33950a-ad07-4777-9641-a62d21f558c1 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c" status: 200 len: 1240 microversion: 2.1 time: 0.202715 Aug 02 09:16:28.003757 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 345/673] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:27 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c => generated 1240 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:28.182129 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-ea00f28a-6e0f-4a8b-bf80-e58a7270a6f7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:28.193619 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-ea00f28a-6e0f-4a8b-bf80-e58a7270a6f7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:28.195311 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-ea00f28a-6e0f-4a8b-bf80-e58a7270a6f7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:28.196709 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-ea00f28a-6e0f-4a8b-bf80-e58a7270a6f7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1722 microversion: 2.20 time: 0.539075 Aug 02 09:16:28.197645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 329/674] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:27 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1722 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:28.375523 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-0a539a23-5df4-40a2-a0cb-4f248f74bf9c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:28.376134 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-0a539a23-5df4-40a2-a0cb-4f248f74bf9c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:28.383965 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0a539a23-5df4-40a2-a0cb-4f248f74bf9c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:28.384690 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0a539a23-5df4-40a2-a0cb-4f248f74bf9c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:28.385474 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0a539a23-5df4-40a2-a0cb-4f248f74bf9c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:28.386073 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0a539a23-5df4-40a2-a0cb-4f248f74bf9c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:28.594015 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-0a539a23-5df4-40a2-a0cb-4f248f74bf9c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:28.602555 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-0a539a23-5df4-40a2-a0cb-4f248f74bf9c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be" status: 200 len: 1363 microversion: 2.1 time: 0.230939 Aug 02 09:16:28.603139 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 346/675] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:28 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:28.821833 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-61437e58-1708-4bb3-8d33-b3e3d9b814b7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:28.822552 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-61437e58-1708-4bb3-8d33-b3e3d9b814b7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:28.829620 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-61437e58-1708-4bb3-8d33-b3e3d9b814b7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:28.830069 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-61437e58-1708-4bb3-8d33-b3e3d9b814b7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:28.830944 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-61437e58-1708-4bb3-8d33-b3e3d9b814b7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:28.831385 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-61437e58-1708-4bb3-8d33-b3e3d9b814b7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:28.926866 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-ff0b939b-648c-4ea9-b224-68055338f9d4 req-ac06feeb-4aec-441b-9168-fbe95912594e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71fb0604-8809-49fd-9b86-e8441c47c2be", "tag": "d6fbfff8-482d-4758-81e9-d3d768e635e3"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:28.952082 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-ff0b939b-648c-4ea9-b224-68055338f9d4 req-ac06feeb-4aec-441b-9168-fbe95912594e service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:28.953328 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-ff0b939b-648c-4ea9-b224-68055338f9d4 req-ac06feeb-4aec-441b-9168-fbe95912594e service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:28.975585 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-ff0b939b-648c-4ea9-b224-68055338f9d4 req-ac06feeb-4aec-441b-9168-fbe95912594e service nova] Creating event network-changed:d6fbfff8-482d-4758-81e9-d3d768e635e3 for instance 71fb0604-8809-49fd-9b86-e8441c47c2be on hv-cinder-84599 Aug 02 09:16:28.988385 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-ff0b939b-648c-4ea9-b224-68055338f9d4 req-ac06feeb-4aec-441b-9168-fbe95912594e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067625 Aug 02 09:16:28.989322 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 347/676] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:29.037943 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ae568b50-e2d4-4b7e-b21f-3a13f6fda2bd tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:29.039816 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ae568b50-e2d4-4b7e-b21f-3a13f6fda2bd tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:29.069414 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ae568b50-e2d4-4b7e-b21f-3a13f6fda2bd tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:29.069992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ae568b50-e2d4-4b7e-b21f-3a13f6fda2bd tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:29.071106 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ae568b50-e2d4-4b7e-b21f-3a13f6fda2bd tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:29.071767 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ae568b50-e2d4-4b7e-b21f-3a13f6fda2bd tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:29.110314 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-61437e58-1708-4bb3-8d33-b3e3d9b814b7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:29.120573 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-61437e58-1708-4bb3-8d33-b3e3d9b814b7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1574 microversion: 2.1 time: 0.303272 Aug 02 09:16:29.121410 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 330/677] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:28 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1574 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:16:29.205363 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ae568b50-e2d4-4b7e-b21f-3a13f6fda2bd tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:29.213317 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ae568b50-e2d4-4b7e-b21f-3a13f6fda2bd tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c" status: 200 len: 1244 microversion: 2.1 time: 0.185024 Aug 02 09:16:29.214166 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 348/678] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:29 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c => generated 1244 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:29.227479 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-bac11e73-e16d-422c-b493-293c1c2c0c5d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:29.228185 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-bac11e73-e16d-422c-b493-293c1c2c0c5d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:29.234408 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bac11e73-e16d-422c-b493-293c1c2c0c5d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:29.234860 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bac11e73-e16d-422c-b493-293c1c2c0c5d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:29.235690 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bac11e73-e16d-422c-b493-293c1c2c0c5d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:29.236124 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bac11e73-e16d-422c-b493-293c1c2c0c5d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:29.485848 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-bac11e73-e16d-422c-b493-293c1c2c0c5d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:29.503673 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-bac11e73-e16d-422c-b493-293c1c2c0c5d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:29.506130 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-bac11e73-e16d-422c-b493-293c1c2c0c5d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:29.508500 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-bac11e73-e16d-422c-b493-293c1c2c0c5d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1722 microversion: 2.20 time: 0.284926 Aug 02 09:16:29.509077 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 331/679] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:29 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:29.628415 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-36ee14cb-06bf-473e-8474-6a5932df28dd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:29.629023 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-36ee14cb-06bf-473e-8474-6a5932df28dd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:29.636223 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-36ee14cb-06bf-473e-8474-6a5932df28dd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:29.637253 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-36ee14cb-06bf-473e-8474-6a5932df28dd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:29.637470 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-36ee14cb-06bf-473e-8474-6a5932df28dd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:29.638099 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-36ee14cb-06bf-473e-8474-6a5932df28dd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:29.807073 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-36ee14cb-06bf-473e-8474-6a5932df28dd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:29.815271 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-36ee14cb-06bf-473e-8474-6a5932df28dd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be" status: 200 len: 1363 microversion: 2.1 time: 0.191206 Aug 02 09:16:29.815775 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 349/680] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:29 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:30.142609 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-2decbf6e-af4e-4474-9f74-235973ec8e28 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:30.143261 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-2decbf6e-af4e-4474-9f74-235973ec8e28 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:30.150141 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2decbf6e-af4e-4474-9f74-235973ec8e28 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:30.151947 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2decbf6e-af4e-4474-9f74-235973ec8e28 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:30.152920 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2decbf6e-af4e-4474-9f74-235973ec8e28 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:30.153468 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2decbf6e-af4e-4474-9f74-235973ec8e28 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:30.235168 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-82e1ee4e-37e3-4ed0-be12-bc8c818b4473 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:30.237031 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-82e1ee4e-37e3-4ed0-be12-bc8c818b4473 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:30.244090 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-82e1ee4e-37e3-4ed0-be12-bc8c818b4473 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:30.244585 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-82e1ee4e-37e3-4ed0-be12-bc8c818b4473 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:30.245370 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-82e1ee4e-37e3-4ed0-be12-bc8c818b4473 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:30.245813 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-82e1ee4e-37e3-4ed0-be12-bc8c818b4473 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:30.343665 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-82e1ee4e-37e3-4ed0-be12-bc8c818b4473 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:30.353169 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-82e1ee4e-37e3-4ed0-be12-bc8c818b4473 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c" status: 200 len: 1300 microversion: 2.1 time: 0.122051 Aug 02 09:16:30.353770 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 350/681] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:30 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c => generated 1300 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:16:30.435113 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-2decbf6e-af4e-4474-9f74-235973ec8e28 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:30.443550 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-2decbf6e-af4e-4474-9f74-235973ec8e28 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1574 microversion: 2.1 time: 0.304851 Aug 02 09:16:30.444153 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 332/682] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:30 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1574 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:30.536656 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-59478e38-72c5-481a-a3cd-de5f3a3005f6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:30.537159 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-59478e38-72c5-481a-a3cd-de5f3a3005f6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:30.543364 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-59478e38-72c5-481a-a3cd-de5f3a3005f6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:30.543821 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-59478e38-72c5-481a-a3cd-de5f3a3005f6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:30.544617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-59478e38-72c5-481a-a3cd-de5f3a3005f6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:30.545060 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-59478e38-72c5-481a-a3cd-de5f3a3005f6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:30.690469 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-59478e38-72c5-481a-a3cd-de5f3a3005f6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:30.700917 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-59478e38-72c5-481a-a3cd-de5f3a3005f6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:30.702906 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-59478e38-72c5-481a-a3cd-de5f3a3005f6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:30.704350 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-59478e38-72c5-481a-a3cd-de5f3a3005f6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1722 microversion: 2.20 time: 0.172812 Aug 02 09:16:30.705127 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 351/683] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:30 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:30.836930 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-07615408-03a0-460f-bcd2-f33b6fbbfcfc tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:30.837448 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-07615408-03a0-460f-bcd2-f33b6fbbfcfc tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:30.843786 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-07615408-03a0-460f-bcd2-f33b6fbbfcfc tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:30.844330 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-07615408-03a0-460f-bcd2-f33b6fbbfcfc tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:30.845155 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-07615408-03a0-460f-bcd2-f33b6fbbfcfc tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:30.845665 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-07615408-03a0-460f-bcd2-f33b6fbbfcfc tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:31.002639 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-07615408-03a0-460f-bcd2-f33b6fbbfcfc tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:31.011265 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-07615408-03a0-460f-bcd2-f33b6fbbfcfc tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be" status: 200 len: 1363 microversion: 2.1 time: 0.178173 Aug 02 09:16:31.011834 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 333/684] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:30 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:31.379280 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4aeb832f-cbd6-4393-ad6e-cbf82bf8339c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:31.381436 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-4aeb832f-cbd6-4393-ad6e-cbf82bf8339c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:31.394880 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4aeb832f-cbd6-4393-ad6e-cbf82bf8339c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:31.395692 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4aeb832f-cbd6-4393-ad6e-cbf82bf8339c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:31.397538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4aeb832f-cbd6-4393-ad6e-cbf82bf8339c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:31.398359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4aeb832f-cbd6-4393-ad6e-cbf82bf8339c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:31.470330 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-696fc6a5-cc0f-4a52-9b35-e20d3a8dae52 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:31.471641 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-696fc6a5-cc0f-4a52-9b35-e20d3a8dae52 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:31.485166 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-696fc6a5-cc0f-4a52-9b35-e20d3a8dae52 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:31.485983 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-696fc6a5-cc0f-4a52-9b35-e20d3a8dae52 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:31.487432 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-696fc6a5-cc0f-4a52-9b35-e20d3a8dae52 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:31.488264 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-696fc6a5-cc0f-4a52-9b35-e20d3a8dae52 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:31.574719 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-4aeb832f-cbd6-4393-ad6e-cbf82bf8339c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:31.583434 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-4aeb832f-cbd6-4393-ad6e-cbf82bf8339c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c" status: 200 len: 1298 microversion: 2.1 time: 0.211019 Aug 02 09:16:31.584071 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 352/685] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:31 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c => generated 1298 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:16:31.730159 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-39ccb361-0ef5-4c1a-b9e1-a0b9235f0963 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:31.731543 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-39ccb361-0ef5-4c1a-b9e1-a0b9235f0963 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:31.741475 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-696fc6a5-cc0f-4a52-9b35-e20d3a8dae52 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:31.746504 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-39ccb361-0ef5-4c1a-b9e1-a0b9235f0963 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:31.747159 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-39ccb361-0ef5-4c1a-b9e1-a0b9235f0963 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:31.750203 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-39ccb361-0ef5-4c1a-b9e1-a0b9235f0963 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:31.761529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-39ccb361-0ef5-4c1a-b9e1-a0b9235f0963 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:31.761805 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-696fc6a5-cc0f-4a52-9b35-e20d3a8dae52 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1574 microversion: 2.1 time: 0.290689 Aug 02 09:16:31.761805 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 334/686] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:31 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1574 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:16:31.979863 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-39ccb361-0ef5-4c1a-b9e1-a0b9235f0963 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:31.994808 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-39ccb361-0ef5-4c1a-b9e1-a0b9235f0963 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:31.997881 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-39ccb361-0ef5-4c1a-b9e1-a0b9235f0963 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:32.000113 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-39ccb361-0ef5-4c1a-b9e1-a0b9235f0963 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1743 microversion: 2.20 time: 0.275926 Aug 02 09:16:32.012202 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 353/687] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:31 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1743 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:16:32.037231 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-74099997-c0a0-46e0-bb22-578c3881460b tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:32.037911 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-74099997-c0a0-46e0-bb22-578c3881460b tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:32.044857 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-74099997-c0a0-46e0-bb22-578c3881460b tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:32.045302 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-74099997-c0a0-46e0-bb22-578c3881460b tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:32.046111 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-74099997-c0a0-46e0-bb22-578c3881460b tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:32.046543 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-74099997-c0a0-46e0-bb22-578c3881460b tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:32.362740 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-74099997-c0a0-46e0-bb22-578c3881460b tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:32.383195 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-74099997-c0a0-46e0-bb22-578c3881460b tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be" status: 200 len: 1363 microversion: 2.1 time: 0.353090 Aug 02 09:16:32.383901 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 335/688] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:32 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be => generated 1363 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:32.607142 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-141c53c8-cee2-452e-b006-a49cc60e1f67 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:32.607757 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-141c53c8-cee2-452e-b006-a49cc60e1f67 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:32.615038 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-141c53c8-cee2-452e-b006-a49cc60e1f67 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:32.615494 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-141c53c8-cee2-452e-b006-a49cc60e1f67 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:32.616320 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-141c53c8-cee2-452e-b006-a49cc60e1f67 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:32.616760 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-141c53c8-cee2-452e-b006-a49cc60e1f67 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:32.782639 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-361c26ee-f177-4b4a-982e-ea938bb498a1 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:32.783901 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-361c26ee-f177-4b4a-982e-ea938bb498a1 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:32.793840 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-361c26ee-f177-4b4a-982e-ea938bb498a1 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:32.794488 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-361c26ee-f177-4b4a-982e-ea938bb498a1 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:32.795618 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-361c26ee-f177-4b4a-982e-ea938bb498a1 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:32.796594 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-361c26ee-f177-4b4a-982e-ea938bb498a1 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:32.800876 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=100 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:32.903662 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-141c53c8-cee2-452e-b006-a49cc60e1f67 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:32.926206 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-141c53c8-cee2-452e-b006-a49cc60e1f67 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c" status: 200 len: 1365 microversion: 2.1 time: 0.323259 Aug 02 09:16:32.928144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 354/689] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:32 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c => generated 1365 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:33.037684 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-686ae688-9ced-406d-a83c-b581246528fa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:33.038877 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-686ae688-9ced-406d-a83c-b581246528fa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:33.050006 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-686ae688-9ced-406d-a83c-b581246528fa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:33.050799 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-686ae688-9ced-406d-a83c-b581246528fa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:33.051665 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-686ae688-9ced-406d-a83c-b581246528fa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:33.055709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-686ae688-9ced-406d-a83c-b581246528fa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:33.063141 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-361c26ee-f177-4b4a-982e-ea938bb498a1 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:33.078104 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-361c26ee-f177-4b4a-982e-ea938bb498a1 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1574 microversion: 2.1 time: 0.300182 Aug 02 09:16:33.093309 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 336/690] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:32 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1574 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:33.404995 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b3af79ac-5bae-4b33-82a8-20241f5d9926 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:33.405726 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b3af79ac-5bae-4b33-82a8-20241f5d9926 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:33.413065 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b3af79ac-5bae-4b33-82a8-20241f5d9926 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:33.413539 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b3af79ac-5bae-4b33-82a8-20241f5d9926 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:33.414317 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b3af79ac-5bae-4b33-82a8-20241f5d9926 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:33.414803 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b3af79ac-5bae-4b33-82a8-20241f5d9926 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:33.664952 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-686ae688-9ced-406d-a83c-b581246528fa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:33.677607 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-686ae688-9ced-406d-a83c-b581246528fa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:33.677607 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-686ae688-9ced-406d-a83c-b581246528fa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:33.677607 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-686ae688-9ced-406d-a83c-b581246528fa tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1743 microversion: 2.20 time: 0.651766 Aug 02 09:16:33.692387 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 355/691] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:33 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1743 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:33.699384 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b3af79ac-5bae-4b33-82a8-20241f5d9926 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:33.710200 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b3af79ac-5bae-4b33-82a8-20241f5d9926 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be" status: 200 len: 1363 microversion: 2.1 time: 0.308205 Aug 02 09:16:33.710200 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 337/692] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:33 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be => generated 1363 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:16:33.904873 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-580311f0-04ef-4cb2-be69-6cb93289711e req-4119f375-eec5-4ee0-84fb-e5c3dbbd2c88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4449fe97-0099-41f0-b88e-d7264a4d324c", "tag": "6093acc7-df9f-48e9-afda-92e299aa6bad"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:33.915933 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-580311f0-04ef-4cb2-be69-6cb93289711e req-4119f375-eec5-4ee0-84fb-e5c3dbbd2c88 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:33.916502 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-580311f0-04ef-4cb2-be69-6cb93289711e req-4119f375-eec5-4ee0-84fb-e5c3dbbd2c88 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:33.928921 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-580311f0-04ef-4cb2-be69-6cb93289711e req-4119f375-eec5-4ee0-84fb-e5c3dbbd2c88 service nova] Creating event network-changed:6093acc7-df9f-48e9-afda-92e299aa6bad for instance 4449fe97-0099-41f0-b88e-d7264a4d324c on hv-cinder-84599 Aug 02 09:16:33.934256 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-580311f0-04ef-4cb2-be69-6cb93289711e req-4119f375-eec5-4ee0-84fb-e5c3dbbd2c88 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033062 Aug 02 09:16:33.935181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 356/693] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:33.949807 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-aaef1caa-c502-45ad-948f-030e118f4a0f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:33.950499 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-aaef1caa-c502-45ad-948f-030e118f4a0f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:33.962536 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-aaef1caa-c502-45ad-948f-030e118f4a0f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:33.963044 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-aaef1caa-c502-45ad-948f-030e118f4a0f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:33.963751 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-aaef1caa-c502-45ad-948f-030e118f4a0f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:33.964214 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-aaef1caa-c502-45ad-948f-030e118f4a0f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:34.089032 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-e0e796a4-3ad0-4a18-80d9-bd5b66f08129 req-c826ac9f-7b46-42b7-adce-ba9eab2cb65e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71fb0604-8809-49fd-9b86-e8441c47c2be", "name": "network-vif-plugged", "status": "completed", "tag": "d6fbfff8-482d-4758-81e9-d3d768e635e3"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:34.101506 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-e0e796a4-3ad0-4a18-80d9-bd5b66f08129 req-c826ac9f-7b46-42b7-adce-ba9eab2cb65e service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:34.102098 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-e0e796a4-3ad0-4a18-80d9-bd5b66f08129 req-c826ac9f-7b46-42b7-adce-ba9eab2cb65e service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:34.113948 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-e0e796a4-3ad0-4a18-80d9-bd5b66f08129 req-c826ac9f-7b46-42b7-adce-ba9eab2cb65e service nova] Creating event network-vif-plugged:d6fbfff8-482d-4758-81e9-d3d768e635e3 for instance 71fb0604-8809-49fd-9b86-e8441c47c2be on hv-cinder-84599 Aug 02 09:16:34.116608 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-aaef1caa-c502-45ad-948f-030e118f4a0f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:34.119240 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-e0e796a4-3ad0-4a18-80d9-bd5b66f08129 req-c826ac9f-7b46-42b7-adce-ba9eab2cb65e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034714 Aug 02 09:16:34.123350 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 357/694] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:16:34.124980 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-aaef1caa-c502-45ad-948f-030e118f4a0f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c" status: 200 len: 1365 microversion: 2.1 time: 0.179251 Aug 02 09:16:34.125708 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 338/695] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:33 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:34.129251 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-0e8d50b7-c1ae-452f-961b-df7bcf24d943 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:34.129946 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-0e8d50b7-c1ae-452f-961b-df7bcf24d943 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:34.132954 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:34.136765 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0e8d50b7-c1ae-452f-961b-df7bcf24d943 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:34.137278 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0e8d50b7-c1ae-452f-961b-df7bcf24d943 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:34.137986 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0e8d50b7-c1ae-452f-961b-df7bcf24d943 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:34.138421 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0e8d50b7-c1ae-452f-961b-df7bcf24d943 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:34.300354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-0e8d50b7-c1ae-452f-961b-df7bcf24d943 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:34.312428 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-0e8d50b7-c1ae-452f-961b-df7bcf24d943 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1574 microversion: 2.1 time: 0.187552 Aug 02 09:16:34.313633 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 358/696] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:34 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1574 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:34.708262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-de14f47c-3cf0-425d-9db4-bdc07f18828e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:34.709205 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-de14f47c-3cf0-425d-9db4-bdc07f18828e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:34.722936 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-de14f47c-3cf0-425d-9db4-bdc07f18828e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:34.723938 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-de14f47c-3cf0-425d-9db4-bdc07f18828e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:34.725526 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-de14f47c-3cf0-425d-9db4-bdc07f18828e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:34.727066 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-de14f47c-3cf0-425d-9db4-bdc07f18828e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:34.730918 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-a2be9288-2459-48ad-aa28-bd982483c186 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:34.731525 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-a2be9288-2459-48ad-aa28-bd982483c186 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:34.747491 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a2be9288-2459-48ad-aa28-bd982483c186 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:34.748229 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a2be9288-2459-48ad-aa28-bd982483c186 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:34.749177 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a2be9288-2459-48ad-aa28-bd982483c186 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:34.749772 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a2be9288-2459-48ad-aa28-bd982483c186 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:35.121415 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-de14f47c-3cf0-425d-9db4-bdc07f18828e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:35.130193 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-de14f47c-3cf0-425d-9db4-bdc07f18828e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:35.131720 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-de14f47c-3cf0-425d-9db4-bdc07f18828e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:35.132923 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-de14f47c-3cf0-425d-9db4-bdc07f18828e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1743 microversion: 2.20 time: 0.434623 Aug 02 09:16:35.133490 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 339/697] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:34 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1743 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:35.138032 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-a2be9288-2459-48ad-aa28-bd982483c186 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:35.146956 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-f77796ff-e676-4905-b091-927d78939612 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:35.147824 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-f77796ff-e676-4905-b091-927d78939612 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:35.154935 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f77796ff-e676-4905-b091-927d78939612 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:35.155708 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f77796ff-e676-4905-b091-927d78939612 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:35.156525 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f77796ff-e676-4905-b091-927d78939612 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:35.156987 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-a2be9288-2459-48ad-aa28-bd982483c186 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be" status: 200 len: 1363 microversion: 2.1 time: 0.429713 Aug 02 09:16:35.157184 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f77796ff-e676-4905-b091-927d78939612 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:35.157914 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 359/698] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:34 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be => generated 1363 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:16:35.336619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-092799a1-5c93-435a-bc31-37eb2e73ac5d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:35.337222 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-092799a1-5c93-435a-bc31-37eb2e73ac5d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:35.343961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-f77796ff-e676-4905-b091-927d78939612 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:35.344683 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-092799a1-5c93-435a-bc31-37eb2e73ac5d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:35.345125 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-092799a1-5c93-435a-bc31-37eb2e73ac5d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:35.345962 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-092799a1-5c93-435a-bc31-37eb2e73ac5d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:35.346708 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-092799a1-5c93-435a-bc31-37eb2e73ac5d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:35.354045 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-f77796ff-e676-4905-b091-927d78939612 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c" status: 200 len: 1365 microversion: 2.1 time: 0.211266 Aug 02 09:16:35.354634 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 340/699] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:35 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:35.507435 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-092799a1-5c93-435a-bc31-37eb2e73ac5d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:35.509821 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=100 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:35.516351 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-092799a1-5c93-435a-bc31-37eb2e73ac5d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1574 microversion: 2.1 time: 0.183982 Aug 02 09:16:35.517057 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 360/700] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:35 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1574 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:36.138558 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-feb57c4e-ee13-441a-a0cb-e1627adc8eb4 req-668ed010-6bd2-428c-ba9e-19ea45fd56fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b54fded6-ca19-48e6-b971-31f061cce0c5", "name": "network-vif-plugged", "status": "completed", "tag": "021d8483-0afc-44b7-b117-6f61fcf5696d"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:36.159021 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-78dca42a-ba09-43d9-a2b5-2ee75d68724d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:36.159752 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-78dca42a-ba09-43d9-a2b5-2ee75d68724d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:36.182125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-feb57c4e-ee13-441a-a0cb-e1627adc8eb4 req-668ed010-6bd2-428c-ba9e-19ea45fd56fd service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:36.182970 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-feb57c4e-ee13-441a-a0cb-e1627adc8eb4 req-668ed010-6bd2-428c-ba9e-19ea45fd56fd service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:36.184563 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-78dca42a-ba09-43d9-a2b5-2ee75d68724d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:36.192766 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-78dca42a-ba09-43d9-a2b5-2ee75d68724d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:36.197455 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-78dca42a-ba09-43d9-a2b5-2ee75d68724d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:36.198237 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-78dca42a-ba09-43d9-a2b5-2ee75d68724d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:36.199892 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-feb57c4e-ee13-441a-a0cb-e1627adc8eb4 req-668ed010-6bd2-428c-ba9e-19ea45fd56fd service nova] Creating event network-vif-plugged:021d8483-0afc-44b7-b117-6f61fcf5696d for instance b54fded6-ca19-48e6-b971-31f061cce0c5 on hv-cinder-84599 Aug 02 09:16:36.206450 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-feb57c4e-ee13-441a-a0cb-e1627adc8eb4 req-668ed010-6bd2-428c-ba9e-19ea45fd56fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073902 Aug 02 09:16:36.208285 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 341/701] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:36.216933 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-4ff52259-14cb-403f-923a-b780d48eefd3 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:36.221255 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-4ff52259-14cb-403f-923a-b780d48eefd3 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:36.231458 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4ff52259-14cb-403f-923a-b780d48eefd3 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:36.232542 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4ff52259-14cb-403f-923a-b780d48eefd3 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:36.233575 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4ff52259-14cb-403f-923a-b780d48eefd3 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:36.234230 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4ff52259-14cb-403f-923a-b780d48eefd3 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:36.630107 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-4ff52259-14cb-403f-923a-b780d48eefd3 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:36.639110 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-78dca42a-ba09-43d9-a2b5-2ee75d68724d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:36.642016 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-4ff52259-14cb-403f-923a-b780d48eefd3 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be" status: 200 len: 1363 microversion: 2.1 time: 0.431378 Aug 02 09:16:36.656607 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 342/702] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:36 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be => generated 1363 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:36.661180 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-78dca42a-ba09-43d9-a2b5-2ee75d68724d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:36.663493 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-64a3a145-e31e-45d3-99cf-fcab544a8b6c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:36.664393 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-64a3a145-e31e-45d3-99cf-fcab544a8b6c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:36.664580 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-78dca42a-ba09-43d9-a2b5-2ee75d68724d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:36.665871 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-78dca42a-ba09-43d9-a2b5-2ee75d68724d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1738 microversion: 2.20 time: 0.513616 Aug 02 09:16:36.667030 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 361/703] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:36 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1738 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:36.672138 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-64a3a145-e31e-45d3-99cf-fcab544a8b6c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:36.672870 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-64a3a145-e31e-45d3-99cf-fcab544a8b6c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:36.674020 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-64a3a145-e31e-45d3-99cf-fcab544a8b6c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:36.674728 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-64a3a145-e31e-45d3-99cf-fcab544a8b6c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:36.676664 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-43ded2e8-2875-4f1a-bc21-4134a4050135 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:36.678140 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-43ded2e8-2875-4f1a-bc21-4134a4050135 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:36.701043 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-43ded2e8-2875-4f1a-bc21-4134a4050135 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:36.701766 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-43ded2e8-2875-4f1a-bc21-4134a4050135 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:36.702802 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-43ded2e8-2875-4f1a-bc21-4134a4050135 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:36.703440 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-43ded2e8-2875-4f1a-bc21-4134a4050135 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:36.994686 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-64a3a145-e31e-45d3-99cf-fcab544a8b6c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:37.013087 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-64a3a145-e31e-45d3-99cf-fcab544a8b6c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c" status: 200 len: 1365 microversion: 2.1 time: 0.353539 Aug 02 09:16:37.028626 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 343/704] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:36 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c => generated 1365 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:37.048313 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-43ded2e8-2875-4f1a-bc21-4134a4050135 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:37.056441 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-43ded2e8-2875-4f1a-bc21-4134a4050135 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1574 microversion: 2.1 time: 0.387394 Aug 02 09:16:37.070875 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 362/705] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:36 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1574 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:37.670677 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-2e719928-66a0-495a-9c5b-97fe3624ba1c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:37.671542 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-2e719928-66a0-495a-9c5b-97fe3624ba1c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:37.675476 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=4 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:37.677117 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=18 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:37.681081 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2e719928-66a0-495a-9c5b-97fe3624ba1c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:37.681834 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2e719928-66a0-495a-9c5b-97fe3624ba1c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:37.683015 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2e719928-66a0-495a-9c5b-97fe3624ba1c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:37.683783 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2e719928-66a0-495a-9c5b-97fe3624ba1c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:37.699590 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-24b94a10-4d37-40bd-a287-a2d8452d35a7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:37.701322 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-24b94a10-4d37-40bd-a287-a2d8452d35a7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:37.718976 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-24b94a10-4d37-40bd-a287-a2d8452d35a7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:37.719809 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-24b94a10-4d37-40bd-a287-a2d8452d35a7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:37.721452 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-24b94a10-4d37-40bd-a287-a2d8452d35a7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:37.722405 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-24b94a10-4d37-40bd-a287-a2d8452d35a7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:37.961570 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-24b94a10-4d37-40bd-a287-a2d8452d35a7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:37.964338 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-2e719928-66a0-495a-9c5b-97fe3624ba1c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:37.973708 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-24b94a10-4d37-40bd-a287-a2d8452d35a7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:37.978082 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-2e719928-66a0-495a-9c5b-97fe3624ba1c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be" status: 200 len: 1547 microversion: 2.1 time: 0.317655 Aug 02 09:16:37.978669 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-24b94a10-4d37-40bd-a287-a2d8452d35a7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:37.978904 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 344/706] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:37 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be => generated 1547 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:38.005791 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-24b94a10-4d37-40bd-a287-a2d8452d35a7 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1738 microversion: 2.20 time: 0.307572 Aug 02 09:16:38.012616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 363/707] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:37 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1738 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:38.012921 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a1919afe-6023-4d95-9650-62f8a243264b tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:38.014185 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-a1919afe-6023-4d95-9650-62f8a243264b tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:38.034315 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a1919afe-6023-4d95-9650-62f8a243264b tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:38.035636 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a1919afe-6023-4d95-9650-62f8a243264b tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:38.037252 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a1919afe-6023-4d95-9650-62f8a243264b tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:38.038345 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a1919afe-6023-4d95-9650-62f8a243264b tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:38.044217 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-1786b801-ffab-423e-b821-7ba527ea38cf tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:38.045940 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-1786b801-ffab-423e-b821-7ba527ea38cf tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:38.066837 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=8 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:38.069962 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1786b801-ffab-423e-b821-7ba527ea38cf tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:38.070725 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1786b801-ffab-423e-b821-7ba527ea38cf tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:38.072024 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1786b801-ffab-423e-b821-7ba527ea38cf tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:38.073835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1786b801-ffab-423e-b821-7ba527ea38cf tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:38.238255 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-a1919afe-6023-4d95-9650-62f8a243264b tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.233612 Aug 02 09:16:38.238871 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 345/708] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Aug 2 09:16:38 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/os-interface => generated 285 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:38.243651 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-4b2d4376-6ef4-48f5-a39f-5e54ac405f55 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:38.244795 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-4b2d4376-6ef4-48f5-a39f-5e54ac405f55 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:38.262306 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4b2d4376-6ef4-48f5-a39f-5e54ac405f55 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:38.262306 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4b2d4376-6ef4-48f5-a39f-5e54ac405f55 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:38.263032 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4b2d4376-6ef4-48f5-a39f-5e54ac405f55 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:38.263824 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4b2d4376-6ef4-48f5-a39f-5e54ac405f55 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:38.404453 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-1786b801-ffab-423e-b821-7ba527ea38cf tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:38.415437 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-1786b801-ffab-423e-b821-7ba527ea38cf tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c" status: 200 len: 1365 microversion: 2.1 time: 0.385492 Aug 02 09:16:38.416830 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 364/709] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:38 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c => generated 1365 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:38.429348 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-fd3c72f6-013b-47f5-bfb8-6bdfdffd4d0a req-a546f12c-20d9-4931-9138-f9eb35e25d19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c36b6524-980c-4f56-b1ad-e71536c08577", "name": "network-vif-plugged", "status": "completed", "tag": "541f0637-de44-45f3-b1dd-7b7924d55993"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:38.440326 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-fd3c72f6-013b-47f5-bfb8-6bdfdffd4d0a req-a546f12c-20d9-4931-9138-f9eb35e25d19 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:38.440773 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-fd3c72f6-013b-47f5-bfb8-6bdfdffd4d0a req-a546f12c-20d9-4931-9138-f9eb35e25d19 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:38.454125 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-fd3c72f6-013b-47f5-bfb8-6bdfdffd4d0a req-a546f12c-20d9-4931-9138-f9eb35e25d19 service nova] Creating event network-vif-plugged:541f0637-de44-45f3-b1dd-7b7924d55993 for instance c36b6524-980c-4f56-b1ad-e71536c08577 on hv-cinder-84599 Aug 02 09:16:38.461886 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-fd3c72f6-013b-47f5-bfb8-6bdfdffd4d0a req-a546f12c-20d9-4931-9138-f9eb35e25d19 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042072 Aug 02 09:16:38.472942 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 365/710] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:38.507867 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-4b2d4376-6ef4-48f5-a39f-5e54ac405f55 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:38.522400 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-4b2d4376-6ef4-48f5-a39f-5e54ac405f55 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1574 microversion: 2.1 time: 0.282465 Aug 02 09:16:38.531645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 346/711] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:38 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1574 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:39.053360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-353f9616-c200-434f-b43f-9e67a6fbeb13 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:39.059419 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-353f9616-c200-434f-b43f-9e67a6fbeb13 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:39.072850 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-353f9616-c200-434f-b43f-9e67a6fbeb13 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:39.073296 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-353f9616-c200-434f-b43f-9e67a6fbeb13 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:39.074699 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-353f9616-c200-434f-b43f-9e67a6fbeb13 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:39.075197 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-353f9616-c200-434f-b43f-9e67a6fbeb13 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:39.298432 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-353f9616-c200-434f-b43f-9e67a6fbeb13 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:39.302167 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-353f9616-c200-434f-b43f-9e67a6fbeb13 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:39.303737 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-353f9616-c200-434f-b43f-9e67a6fbeb13 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:39.304956 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-353f9616-c200-434f-b43f-9e67a6fbeb13 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1738 microversion: 2.20 time: 0.260625 Aug 02 09:16:39.305535 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 366/712] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:39 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1738 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:39.436835 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-bc4d35dd-b21b-41ae-9420-df0e633c4c10 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:39.437553 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-bc4d35dd-b21b-41ae-9420-df0e633c4c10 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:39.444180 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bc4d35dd-b21b-41ae-9420-df0e633c4c10 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:39.444637 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bc4d35dd-b21b-41ae-9420-df0e633c4c10 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:39.445398 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bc4d35dd-b21b-41ae-9420-df0e633c4c10 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:39.445859 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bc4d35dd-b21b-41ae-9420-df0e633c4c10 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:39.554587 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-f43be0a7-e207-4d96-af27-8dc5ff6b2fb4 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:39.554766 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-f43be0a7-e207-4d96-af27-8dc5ff6b2fb4 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:39.562914 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f43be0a7-e207-4d96-af27-8dc5ff6b2fb4 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:39.563626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f43be0a7-e207-4d96-af27-8dc5ff6b2fb4 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:39.565170 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f43be0a7-e207-4d96-af27-8dc5ff6b2fb4 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:39.565843 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f43be0a7-e207-4d96-af27-8dc5ff6b2fb4 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:39.601242 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-bc4d35dd-b21b-41ae-9420-df0e633c4c10 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:39.610501 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-bc4d35dd-b21b-41ae-9420-df0e633c4c10 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c" status: 200 len: 1365 microversion: 2.1 time: 0.177400 Aug 02 09:16:39.613402 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 347/713] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:39 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:39.734119 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-f8efc69b-ce26-4baa-be0d-d06dcdbbbf0f req-01052509-7056-44fc-8040-af09bed27819 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71fb0604-8809-49fd-9b86-e8441c47c2be", "tag": "d6fbfff8-482d-4758-81e9-d3d768e635e3"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:39.748656 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-f8efc69b-ce26-4baa-be0d-d06dcdbbbf0f req-01052509-7056-44fc-8040-af09bed27819 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:39.749800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-f8efc69b-ce26-4baa-be0d-d06dcdbbbf0f req-01052509-7056-44fc-8040-af09bed27819 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:39.766127 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-f8efc69b-ce26-4baa-be0d-d06dcdbbbf0f req-01052509-7056-44fc-8040-af09bed27819 service nova] Creating event network-changed:d6fbfff8-482d-4758-81e9-d3d768e635e3 for instance 71fb0604-8809-49fd-9b86-e8441c47c2be on hv-cinder-84599 Aug 02 09:16:39.779050 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-f8efc69b-ce26-4baa-be0d-d06dcdbbbf0f req-01052509-7056-44fc-8040-af09bed27819 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133392 Aug 02 09:16:39.780311 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 348/714] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:39.854847 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-f43be0a7-e207-4d96-af27-8dc5ff6b2fb4 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:39.867638 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-f43be0a7-e207-4d96-af27-8dc5ff6b2fb4 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1574 microversion: 2.1 time: 0.318496 Aug 02 09:16:39.871723 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 367/715] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:39 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1574 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:40.330808 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-3dea283f-fbc1-41d0-aa7a-842368acafdf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:40.331312 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-3dea283f-fbc1-41d0-aa7a-842368acafdf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:40.349615 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3dea283f-fbc1-41d0-aa7a-842368acafdf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:40.350410 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3dea283f-fbc1-41d0-aa7a-842368acafdf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:40.351369 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3dea283f-fbc1-41d0-aa7a-842368acafdf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:40.352000 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3dea283f-fbc1-41d0-aa7a-842368acafdf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:40.639230 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-804fa948-4ae3-4c56-bdbb-3e43cbe64005 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:40.640521 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-804fa948-4ae3-4c56-bdbb-3e43cbe64005 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:40.657181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-804fa948-4ae3-4c56-bdbb-3e43cbe64005 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:40.657767 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-3dea283f-fbc1-41d0-aa7a-842368acafdf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:40.660934 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-804fa948-4ae3-4c56-bdbb-3e43cbe64005 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:40.662226 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-804fa948-4ae3-4c56-bdbb-3e43cbe64005 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:40.662636 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-804fa948-4ae3-4c56-bdbb-3e43cbe64005 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:40.689734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-3dea283f-fbc1-41d0-aa7a-842368acafdf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:40.700970 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-3dea283f-fbc1-41d0-aa7a-842368acafdf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:40.706178 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-3dea283f-fbc1-41d0-aa7a-842368acafdf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1738 microversion: 2.20 time: 0.379014 Aug 02 09:16:40.706783 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 349/716] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:40 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1738 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:40.905910 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-9b097a92-b00f-4592-8502-1056a9b04cf1 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:40.907552 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-9b097a92-b00f-4592-8502-1056a9b04cf1 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:40.925361 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9b097a92-b00f-4592-8502-1056a9b04cf1 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:40.928206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9b097a92-b00f-4592-8502-1056a9b04cf1 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:40.931503 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9b097a92-b00f-4592-8502-1056a9b04cf1 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:40.932358 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9b097a92-b00f-4592-8502-1056a9b04cf1 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:41.225870 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-804fa948-4ae3-4c56-bdbb-3e43cbe64005 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:41.237661 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-804fa948-4ae3-4c56-bdbb-3e43cbe64005 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c" status: 200 len: 1365 microversion: 2.1 time: 0.601851 Aug 02 09:16:41.240536 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 368/717] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:40 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c => generated 1365 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:41.387204 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-9b097a92-b00f-4592-8502-1056a9b04cf1 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:41.403462 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-9b097a92-b00f-4592-8502-1056a9b04cf1 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1574 microversion: 2.1 time: 0.504678 Aug 02 09:16:41.404361 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 350/718] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:40 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1574 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:16:41.731551 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-089c8d4a-8cdb-443c-b28d-f17bb7c95f09 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:41.736960 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-089c8d4a-8cdb-443c-b28d-f17bb7c95f09 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:41.745736 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-089c8d4a-8cdb-443c-b28d-f17bb7c95f09 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:41.746424 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-089c8d4a-8cdb-443c-b28d-f17bb7c95f09 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:41.747672 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-089c8d4a-8cdb-443c-b28d-f17bb7c95f09 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:41.748652 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-089c8d4a-8cdb-443c-b28d-f17bb7c95f09 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:41.990718 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-089c8d4a-8cdb-443c-b28d-f17bb7c95f09 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:42.013085 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-089c8d4a-8cdb-443c-b28d-f17bb7c95f09 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:42.016300 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-089c8d4a-8cdb-443c-b28d-f17bb7c95f09 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:42.019389 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-089c8d4a-8cdb-443c-b28d-f17bb7c95f09 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1738 microversion: 2.20 time: 0.291154 Aug 02 09:16:42.020695 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 369/719] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:41 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1738 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:42.261687 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b6eac8a6-24ba-46ff-a235-bcc119bfcb3c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:42.262876 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b6eac8a6-24ba-46ff-a235-bcc119bfcb3c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:42.270868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b6eac8a6-24ba-46ff-a235-bcc119bfcb3c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:42.283762 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b6eac8a6-24ba-46ff-a235-bcc119bfcb3c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:42.285158 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b6eac8a6-24ba-46ff-a235-bcc119bfcb3c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:42.285619 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b6eac8a6-24ba-46ff-a235-bcc119bfcb3c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:42.435657 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-bd328747-5cab-40f0-af33-7911fc654540 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:42.436740 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-bd328747-5cab-40f0-af33-7911fc654540 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:42.461145 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bd328747-5cab-40f0-af33-7911fc654540 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:42.461718 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bd328747-5cab-40f0-af33-7911fc654540 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:42.462839 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bd328747-5cab-40f0-af33-7911fc654540 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:42.463291 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bd328747-5cab-40f0-af33-7911fc654540 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:42.688143 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b6eac8a6-24ba-46ff-a235-bcc119bfcb3c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:42.702832 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b6eac8a6-24ba-46ff-a235-bcc119bfcb3c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c" status: 200 len: 1365 microversion: 2.1 time: 0.444910 Aug 02 09:16:42.707740 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 351/720] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:42 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c => generated 1365 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:42.715510 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-a697bafe-b9da-468d-abb2-4ca3b002d721 req-c601bf33-4f07-4393-b7c5-4bce8ded9549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4449fe97-0099-41f0-b88e-d7264a4d324c", "name": "network-vif-plugged", "status": "completed", "tag": "6093acc7-df9f-48e9-afda-92e299aa6bad"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:42.738784 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-a697bafe-b9da-468d-abb2-4ca3b002d721 req-c601bf33-4f07-4393-b7c5-4bce8ded9549 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:42.739235 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-a697bafe-b9da-468d-abb2-4ca3b002d721 req-c601bf33-4f07-4393-b7c5-4bce8ded9549 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:42.769651 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-a697bafe-b9da-468d-abb2-4ca3b002d721 req-c601bf33-4f07-4393-b7c5-4bce8ded9549 service nova] Creating event network-vif-plugged:6093acc7-df9f-48e9-afda-92e299aa6bad for instance 4449fe97-0099-41f0-b88e-d7264a4d324c on hv-cinder-84599 Aug 02 09:16:42.782302 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-a697bafe-b9da-468d-abb2-4ca3b002d721 req-c601bf33-4f07-4393-b7c5-4bce8ded9549 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071281 Aug 02 09:16:42.784030 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 352/721] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:42.812333 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-bd328747-5cab-40f0-af33-7911fc654540 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:42.825801 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-bd328747-5cab-40f0-af33-7911fc654540 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1561 microversion: 2.1 time: 0.398093 Aug 02 09:16:42.840438 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 370/722] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:42 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1561 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:43.049504 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-65b1cc7a-1d0f-4f77-9e66-de8f15ea4d3b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:43.052252 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-65b1cc7a-1d0f-4f77-9e66-de8f15ea4d3b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:43.078189 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-65b1cc7a-1d0f-4f77-9e66-de8f15ea4d3b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:43.104308 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-65b1cc7a-1d0f-4f77-9e66-de8f15ea4d3b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:43.104308 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-65b1cc7a-1d0f-4f77-9e66-de8f15ea4d3b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:43.104308 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-65b1cc7a-1d0f-4f77-9e66-de8f15ea4d3b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:43.403461 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-65b1cc7a-1d0f-4f77-9e66-de8f15ea4d3b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:43.419405 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-65b1cc7a-1d0f-4f77-9e66-de8f15ea4d3b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:43.423866 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-65b1cc7a-1d0f-4f77-9e66-de8f15ea4d3b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:43.428366 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-65b1cc7a-1d0f-4f77-9e66-de8f15ea4d3b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1738 microversion: 2.20 time: 0.382670 Aug 02 09:16:43.430918 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 353/723] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:43 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1738 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:43.735552 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-b8f10e0a-3733-4a5f-863e-0204fa81198f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:43.736547 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-b8f10e0a-3733-4a5f-863e-0204fa81198f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:43.743611 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b8f10e0a-3733-4a5f-863e-0204fa81198f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:43.744079 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b8f10e0a-3733-4a5f-863e-0204fa81198f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:43.744932 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b8f10e0a-3733-4a5f-863e-0204fa81198f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:43.745365 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b8f10e0a-3733-4a5f-863e-0204fa81198f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:43.924751 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-b8f10e0a-3733-4a5f-863e-0204fa81198f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:43.932859 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-b8f10e0a-3733-4a5f-863e-0204fa81198f tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c" status: 200 len: 1365 microversion: 2.1 time: 0.201425 Aug 02 09:16:43.933484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 371/724] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:43 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c => generated 1365 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:44.466320 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-edf7ad8a-7e5a-4f68-9bd5-870c221d57a8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:44.468749 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-edf7ad8a-7e5a-4f68-9bd5-870c221d57a8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:44.475097 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-edf7ad8a-7e5a-4f68-9bd5-870c221d57a8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:44.475487 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-edf7ad8a-7e5a-4f68-9bd5-870c221d57a8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:44.476451 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-edf7ad8a-7e5a-4f68-9bd5-870c221d57a8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:44.476728 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-edf7ad8a-7e5a-4f68-9bd5-870c221d57a8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:44.679525 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-edf7ad8a-7e5a-4f68-9bd5-870c221d57a8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:44.689910 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-edf7ad8a-7e5a-4f68-9bd5-870c221d57a8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:44.692692 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-edf7ad8a-7e5a-4f68-9bd5-870c221d57a8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:44.693968 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-edf7ad8a-7e5a-4f68-9bd5-870c221d57a8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1738 microversion: 2.20 time: 0.234490 Aug 02 09:16:44.694687 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 354/725] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:44 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1738 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:44.963537 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-088c15db-b379-4120-9ea7-55fbda2b4eb5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:44.966213 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-088c15db-b379-4120-9ea7-55fbda2b4eb5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:44.975341 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-088c15db-b379-4120-9ea7-55fbda2b4eb5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:44.976327 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-088c15db-b379-4120-9ea7-55fbda2b4eb5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:44.977436 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-088c15db-b379-4120-9ea7-55fbda2b4eb5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:44.978096 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-088c15db-b379-4120-9ea7-55fbda2b4eb5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:45.209140 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-088c15db-b379-4120-9ea7-55fbda2b4eb5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:45.217533 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-088c15db-b379-4120-9ea7-55fbda2b4eb5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c" status: 200 len: 1365 microversion: 2.1 time: 0.266397 Aug 02 09:16:45.232524 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 372/726] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:44 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:45.723875 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-f5f9c0e9-2033-4b9c-bafd-08f60d0c3bd4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:45.725930 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-f5f9c0e9-2033-4b9c-bafd-08f60d0c3bd4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:45.741969 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f5f9c0e9-2033-4b9c-bafd-08f60d0c3bd4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:45.741969 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f5f9c0e9-2033-4b9c-bafd-08f60d0c3bd4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:45.744543 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f5f9c0e9-2033-4b9c-bafd-08f60d0c3bd4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:45.745146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f5f9c0e9-2033-4b9c-bafd-08f60d0c3bd4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:45.774644 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=100 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:45.960007 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-f5f9c0e9-2033-4b9c-bafd-08f60d0c3bd4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:45.972770 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-f5f9c0e9-2033-4b9c-bafd-08f60d0c3bd4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:45.975107 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-f5f9c0e9-2033-4b9c-bafd-08f60d0c3bd4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:45.976563 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-f5f9c0e9-2033-4b9c-bafd-08f60d0c3bd4 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1738 microversion: 2.20 time: 0.257490 Aug 02 09:16:45.977619 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 355/727] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:45 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1738 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:46.240564 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d5b8f3d7-1c3e-47d9-840b-e69a51d9c837 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:46.241281 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-d5b8f3d7-1c3e-47d9-840b-e69a51d9c837 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:46.259609 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d5b8f3d7-1c3e-47d9-840b-e69a51d9c837 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:46.260060 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d5b8f3d7-1c3e-47d9-840b-e69a51d9c837 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:46.261123 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d5b8f3d7-1c3e-47d9-840b-e69a51d9c837 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:46.261788 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d5b8f3d7-1c3e-47d9-840b-e69a51d9c837 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:46.496176 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d5b8f3d7-1c3e-47d9-840b-e69a51d9c837 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:46.505149 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-d5b8f3d7-1c3e-47d9-840b-e69a51d9c837 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c" status: 200 len: 1555 microversion: 2.1 time: 0.269633 Aug 02 09:16:46.520582 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 373/728] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:16:46 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c => generated 1555 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:16:46.537049 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-91790d54-cf62-40c7-a21d-31a0adda70c5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:46.538177 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-91790d54-cf62-40c7-a21d-31a0adda70c5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:46.549136 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-91790d54-cf62-40c7-a21d-31a0adda70c5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:46.550858 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-91790d54-cf62-40c7-a21d-31a0adda70c5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:46.552907 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-91790d54-cf62-40c7-a21d-31a0adda70c5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:46.554398 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-91790d54-cf62-40c7-a21d-31a0adda70c5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:46.693379 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-91790d54-cf62-40c7-a21d-31a0adda70c5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.169724 Aug 02 09:16:46.701917 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 356/729] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Aug 2 09:16:46 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-interface => generated 284 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:16:47.012428 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-833b7279-0aa5-45fd-aa4e-d4cd406c07a8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:47.013642 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-833b7279-0aa5-45fd-aa4e-d4cd406c07a8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:47.030218 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-833b7279-0aa5-45fd-aa4e-d4cd406c07a8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:47.031132 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-833b7279-0aa5-45fd-aa4e-d4cd406c07a8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:47.032199 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-833b7279-0aa5-45fd-aa4e-d4cd406c07a8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:47.032854 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-833b7279-0aa5-45fd-aa4e-d4cd406c07a8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:47.234800 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-833b7279-0aa5-45fd-aa4e-d4cd406c07a8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:47.250513 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-833b7279-0aa5-45fd-aa4e-d4cd406c07a8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:47.253541 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-833b7279-0aa5-45fd-aa4e-d4cd406c07a8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:47.255505 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-833b7279-0aa5-45fd-aa4e-d4cd406c07a8 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1738 microversion: 2.20 time: 0.250510 Aug 02 09:16:47.256728 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 374/730] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:47 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1738 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:48.294530 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b47633ab-ba2a-4818-9781-72f8f58fcc9b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:48.295324 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b47633ab-ba2a-4818-9781-72f8f58fcc9b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:48.302408 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b47633ab-ba2a-4818-9781-72f8f58fcc9b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:48.302947 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b47633ab-ba2a-4818-9781-72f8f58fcc9b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:48.303731 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b47633ab-ba2a-4818-9781-72f8f58fcc9b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:48.304192 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b47633ab-ba2a-4818-9781-72f8f58fcc9b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:48.453542 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b47633ab-ba2a-4818-9781-72f8f58fcc9b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:48.463148 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b47633ab-ba2a-4818-9781-72f8f58fcc9b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:48.464588 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b47633ab-ba2a-4818-9781-72f8f58fcc9b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:48.465789 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b47633ab-ba2a-4818-9781-72f8f58fcc9b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1738 microversion: 2.20 time: 0.175980 Aug 02 09:16:48.482040 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 357/731] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:48 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:48.525085 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-731d0bc0-33db-4134-88d1-4ac430634bab req-ff81cf05-6ae1-4879-b02c-f6f830bbdee8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4449fe97-0099-41f0-b88e-d7264a4d324c", "tag": "6093acc7-df9f-48e9-afda-92e299aa6bad"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:48.536537 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-731d0bc0-33db-4134-88d1-4ac430634bab req-ff81cf05-6ae1-4879-b02c-f6f830bbdee8 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:48.537273 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-731d0bc0-33db-4134-88d1-4ac430634bab req-ff81cf05-6ae1-4879-b02c-f6f830bbdee8 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:48.549307 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-731d0bc0-33db-4134-88d1-4ac430634bab req-ff81cf05-6ae1-4879-b02c-f6f830bbdee8 service nova] Creating event network-changed:6093acc7-df9f-48e9-afda-92e299aa6bad for instance 4449fe97-0099-41f0-b88e-d7264a4d324c on hv-cinder-84599 Aug 02 09:16:48.572089 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-731d0bc0-33db-4134-88d1-4ac430634bab req-ff81cf05-6ae1-4879-b02c-f6f830bbdee8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050285 Aug 02 09:16:48.572734 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 375/732] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:16:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:16:49.491979 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-d3d56f0a-a623-4983-b3db-015bdd80744b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:49.493427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-d3d56f0a-a623-4983-b3db-015bdd80744b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:49.501393 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d3d56f0a-a623-4983-b3db-015bdd80744b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:49.501897 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d3d56f0a-a623-4983-b3db-015bdd80744b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:49.502881 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d3d56f0a-a623-4983-b3db-015bdd80744b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:49.504424 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d3d56f0a-a623-4983-b3db-015bdd80744b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:49.694276 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-d3d56f0a-a623-4983-b3db-015bdd80744b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:49.708874 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-d3d56f0a-a623-4983-b3db-015bdd80744b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:49.710967 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-d3d56f0a-a623-4983-b3db-015bdd80744b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:49.712509 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-d3d56f0a-a623-4983-b3db-015bdd80744b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1738 microversion: 2.20 time: 0.226761 Aug 02 09:16:49.728848 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 358/733] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:49 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:50.738116 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-c182f31c-345b-4045-aa3f-f5ab14a93059 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:50.738858 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-c182f31c-345b-4045-aa3f-f5ab14a93059 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:50.746490 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c182f31c-345b-4045-aa3f-f5ab14a93059 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:50.746852 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c182f31c-345b-4045-aa3f-f5ab14a93059 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:50.747630 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c182f31c-345b-4045-aa3f-f5ab14a93059 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:50.748061 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c182f31c-345b-4045-aa3f-f5ab14a93059 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:50.894571 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-c182f31c-345b-4045-aa3f-f5ab14a93059 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:50.903135 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-c182f31c-345b-4045-aa3f-f5ab14a93059 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:50.904701 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-c182f31c-345b-4045-aa3f-f5ab14a93059 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:50.905895 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-c182f31c-345b-4045-aa3f-f5ab14a93059 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1738 microversion: 2.20 time: 0.172354 Aug 02 09:16:50.906478 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 376/734] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:50 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:51.929897 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-bee718fc-9d8f-43cd-90e3-cb1d6f476a9d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:51.930745 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-bee718fc-9d8f-43cd-90e3-cb1d6f476a9d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:51.938808 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bee718fc-9d8f-43cd-90e3-cb1d6f476a9d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:51.939547 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bee718fc-9d8f-43cd-90e3-cb1d6f476a9d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:51.941087 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bee718fc-9d8f-43cd-90e3-cb1d6f476a9d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:51.941823 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bee718fc-9d8f-43cd-90e3-cb1d6f476a9d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:52.093483 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-bee718fc-9d8f-43cd-90e3-cb1d6f476a9d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:52.106065 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-bee718fc-9d8f-43cd-90e3-cb1d6f476a9d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:52.108001 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-bee718fc-9d8f-43cd-90e3-cb1d6f476a9d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:52.109730 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-bee718fc-9d8f-43cd-90e3-cb1d6f476a9d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1720 microversion: 2.20 time: 0.184458 Aug 02 09:16:52.110372 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 359/735] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:51 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:53.134497 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-e11d552e-5d97-4fc2-ab1a-63bd01f72779 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:53.142806 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-e11d552e-5d97-4fc2-ab1a-63bd01f72779 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:53.142806 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e11d552e-5d97-4fc2-ab1a-63bd01f72779 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:53.142806 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e11d552e-5d97-4fc2-ab1a-63bd01f72779 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:53.143184 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e11d552e-5d97-4fc2-ab1a-63bd01f72779 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:53.144301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e11d552e-5d97-4fc2-ab1a-63bd01f72779 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:53.285865 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-e11d552e-5d97-4fc2-ab1a-63bd01f72779 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:53.299347 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-e11d552e-5d97-4fc2-ab1a-63bd01f72779 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:53.300964 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-e11d552e-5d97-4fc2-ab1a-63bd01f72779 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:53.302475 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-e11d552e-5d97-4fc2-ab1a-63bd01f72779 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1720 microversion: 2.20 time: 0.171986 Aug 02 09:16:53.303054 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 377/736] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:53 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:54.336308 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-866ced15-69fd-42a8-a6b4-5070d0d03cd3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:54.336930 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-866ced15-69fd-42a8-a6b4-5070d0d03cd3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:54.339326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:54.344805 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-866ced15-69fd-42a8-a6b4-5070d0d03cd3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:54.345338 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-866ced15-69fd-42a8-a6b4-5070d0d03cd3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:54.346026 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-866ced15-69fd-42a8-a6b4-5070d0d03cd3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:54.346464 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-866ced15-69fd-42a8-a6b4-5070d0d03cd3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:54.392996 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-706ccb2c-6cec-407d-900b-f4f03c86e2d1 req-75826517-5bbc-4630-a422-b6774d06cf3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b54fded6-ca19-48e6-b971-31f061cce0c5", "name": "network-vif-unplugged", "status": "completed", "tag": "021d8483-0afc-44b7-b117-6f61fcf5696d"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:54.404478 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-706ccb2c-6cec-407d-900b-f4f03c86e2d1 req-75826517-5bbc-4630-a422-b6774d06cf3a service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:54.405034 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-706ccb2c-6cec-407d-900b-f4f03c86e2d1 req-75826517-5bbc-4630-a422-b6774d06cf3a service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:54.417559 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-706ccb2c-6cec-407d-900b-f4f03c86e2d1 req-75826517-5bbc-4630-a422-b6774d06cf3a service nova] Creating event network-vif-unplugged:021d8483-0afc-44b7-b117-6f61fcf5696d for instance b54fded6-ca19-48e6-b971-31f061cce0c5 on hv-cinder-84599 Aug 02 09:16:54.422477 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-706ccb2c-6cec-407d-900b-f4f03c86e2d1 req-75826517-5bbc-4630-a422-b6774d06cf3a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033183 Aug 02 09:16:54.423389 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 378/737] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:16:54.506864 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-866ced15-69fd-42a8-a6b4-5070d0d03cd3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:54.515664 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-866ced15-69fd-42a8-a6b4-5070d0d03cd3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:54.517498 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-866ced15-69fd-42a8-a6b4-5070d0d03cd3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:54.518425 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-866ced15-69fd-42a8-a6b4-5070d0d03cd3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1720 microversion: 2.20 time: 0.186359 Aug 02 09:16:54.519353 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 360/738] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:54 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1720 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:55.543178 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d238af6b-81db-4de3-b3cc-0a9750ad176a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:55.543900 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-d238af6b-81db-4de3-b3cc-0a9750ad176a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:55.550665 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d238af6b-81db-4de3-b3cc-0a9750ad176a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:55.551108 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d238af6b-81db-4de3-b3cc-0a9750ad176a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:55.551885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d238af6b-81db-4de3-b3cc-0a9750ad176a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:55.552413 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d238af6b-81db-4de3-b3cc-0a9750ad176a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:55.568538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=100 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:16:55.700246 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d238af6b-81db-4de3-b3cc-0a9750ad176a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:55.709696 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d238af6b-81db-4de3-b3cc-0a9750ad176a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:55.711278 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d238af6b-81db-4de3-b3cc-0a9750ad176a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:55.712589 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-d238af6b-81db-4de3-b3cc-0a9750ad176a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1720 microversion: 2.20 time: 0.174142 Aug 02 09:16:55.713289 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 379/739] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:55 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1720 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:16:56.736473 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-91f17882-6ef2-4a54-ad34-45d3fd45daed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:56.737108 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-91f17882-6ef2-4a54-ad34-45d3fd45daed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:56.744505 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-91f17882-6ef2-4a54-ad34-45d3fd45daed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:56.744955 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-91f17882-6ef2-4a54-ad34-45d3fd45daed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:56.745831 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-91f17882-6ef2-4a54-ad34-45d3fd45daed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:56.746298 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-91f17882-6ef2-4a54-ad34-45d3fd45daed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:56.902342 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-91f17882-6ef2-4a54-ad34-45d3fd45daed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:56.915229 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-91f17882-6ef2-4a54-ad34-45d3fd45daed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:56.916755 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-91f17882-6ef2-4a54-ad34-45d3fd45daed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:56.917934 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-91f17882-6ef2-4a54-ad34-45d3fd45daed tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1720 microversion: 2.20 time: 0.185584 Aug 02 09:16:56.918487 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 361/740] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:56 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1720 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:16:57.941519 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-63d096ed-ff73-40bc-a1fd-b1c3a7377c6d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:57.942143 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-63d096ed-ff73-40bc-a1fd-b1c3a7377c6d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:57.948680 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-63d096ed-ff73-40bc-a1fd-b1c3a7377c6d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:57.949176 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-63d096ed-ff73-40bc-a1fd-b1c3a7377c6d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:57.949938 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-63d096ed-ff73-40bc-a1fd-b1c3a7377c6d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:57.950385 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-63d096ed-ff73-40bc-a1fd-b1c3a7377c6d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:58.100720 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-63d096ed-ff73-40bc-a1fd-b1c3a7377c6d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:58.109304 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-63d096ed-ff73-40bc-a1fd-b1c3a7377c6d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:58.110839 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-63d096ed-ff73-40bc-a1fd-b1c3a7377c6d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:58.112040 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-63d096ed-ff73-40bc-a1fd-b1c3a7377c6d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1720 microversion: 2.20 time: 0.175024 Aug 02 09:16:58.113368 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 380/741] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:57 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:59.137963 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-89b62641-f6d3-4264-ae1b-e8850c7c8c23 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:16:59.138583 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-89b62641-f6d3-4264-ae1b-e8850c7c8c23 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:59.151047 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-89b62641-f6d3-4264-ae1b-e8850c7c8c23 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:59.151601 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-89b62641-f6d3-4264-ae1b-e8850c7c8c23 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:59.152443 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-89b62641-f6d3-4264-ae1b-e8850c7c8c23 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:59.152885 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-89b62641-f6d3-4264-ae1b-e8850c7c8c23 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:59.307849 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-89b62641-f6d3-4264-ae1b-e8850c7c8c23 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:59.318453 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-89b62641-f6d3-4264-ae1b-e8850c7c8c23 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:59.320048 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-89b62641-f6d3-4264-ae1b-e8850c7c8c23 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:16:59.321271 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-89b62641-f6d3-4264-ae1b-e8850c7c8c23 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1723 microversion: 2.20 time: 0.188255 Aug 02 09:16:59.321864 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 362/742] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:16:59 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:16:59.354727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-90601dac-f2b7-4660-bfa2-381f9b34cd44 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c73b532-bf70-4f16-aca0-8f785ae5e0c9"}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:16:59.357208 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-90601dac-f2b7-4660-bfa2-381f9b34cd44 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:16:59.364726 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-90601dac-f2b7-4660-bfa2-381f9b34cd44 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:59.365325 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-90601dac-f2b7-4660-bfa2-381f9b34cd44 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:16:59.366229 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-90601dac-f2b7-4660-bfa2-381f9b34cd44 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:16:59.366761 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-90601dac-f2b7-4660-bfa2-381f9b34cd44 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:00.507436 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-90601dac-f2b7-4660-bfa2-381f9b34cd44 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "POST /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.159923 Aug 02 09:17:00.508916 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 381/743] 10.222.0.20 () {62 vars in 1364 bytes} [Tue Aug 2 09:16:59 2022] POST /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5/os-volume_attachments => generated 188 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 02 09:17:00.664712 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-0ab80c2f-0093-42ef-a3f9-4d7086fa85f6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:00.665308 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-0ab80c2f-0093-42ef-a3f9-4d7086fa85f6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:00.672262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0ab80c2f-0093-42ef-a3f9-4d7086fa85f6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:00.672683 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0ab80c2f-0093-42ef-a3f9-4d7086fa85f6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:00.673466 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0ab80c2f-0093-42ef-a3f9-4d7086fa85f6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:00.673932 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0ab80c2f-0093-42ef-a3f9-4d7086fa85f6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:01.507012 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-0ab80c2f-0093-42ef-a3f9-4d7086fa85f6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5/os-volume_attachments/8c73b532-bf70-4f16-aca0-8f785ae5e0c9" status: 202 len: 0 microversion: 2.20 time: 0.846906 Aug 02 09:17:01.507535 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 363/744] 10.222.0.20 () {60 vars in 1457 bytes} [Tue Aug 2 09:17:00 2022] DELETE /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5/os-volume_attachments/8c73b532-bf70-4f16-aca0-8f785ae5e0c9 => generated 0 bytes in 849 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 02 09:17:01.588942 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-c4ac9f2f-df89-4e3f-9bd4-2712b761bd4a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:17:01.589677 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-c4ac9f2f-df89-4e3f-9bd4-2712b761bd4a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:01.599386 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c4ac9f2f-df89-4e3f-9bd4-2712b761bd4a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:01.599824 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c4ac9f2f-df89-4e3f-9bd4-2712b761bd4a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:01.600647 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c4ac9f2f-df89-4e3f-9bd4-2712b761bd4a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:01.601088 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c4ac9f2f-df89-4e3f-9bd4-2712b761bd4a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:01.634204 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-c4ac9f2f-df89-4e3f-9bd4-2712b761bd4a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118525) unshelve /opt/stack/nova/nova/compute/api.py:4531}} Aug 02 09:17:01.968350 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-c4ac9f2f-df89-4e3f-9bd4-2712b761bd4a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "POST /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5/action" status: 202 len: 0 microversion: 2.20 time: 0.383677 Aug 02 09:17:01.969042 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 382/745] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Aug 2 09:17:01 2022] POST /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:17:01.978756 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-28ecfcb1-5c58-498a-af30-f127347cc728 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:01.979563 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-28ecfcb1-5c58-498a-af30-f127347cc728 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:01.987858 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-28ecfcb1-5c58-498a-af30-f127347cc728 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:01.988365 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-28ecfcb1-5c58-498a-af30-f127347cc728 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:01.989154 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-28ecfcb1-5c58-498a-af30-f127347cc728 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:01.989592 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-28ecfcb1-5c58-498a-af30-f127347cc728 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:02.142410 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-28ecfcb1-5c58-498a-af30-f127347cc728 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:02.152475 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-28ecfcb1-5c58-498a-af30-f127347cc728 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:02.154534 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-28ecfcb1-5c58-498a-af30-f127347cc728 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:02.156026 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-28ecfcb1-5c58-498a-af30-f127347cc728 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1671 microversion: 2.20 time: 0.181608 Aug 02 09:17:02.156904 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 364/746] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:01 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1671 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:03.181693 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-e8d19aa4-6ed3-4b8d-b96b-fafb1a2f0d8a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:03.183025 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-e8d19aa4-6ed3-4b8d-b96b-fafb1a2f0d8a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:03.189390 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e8d19aa4-6ed3-4b8d-b96b-fafb1a2f0d8a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:03.189937 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e8d19aa4-6ed3-4b8d-b96b-fafb1a2f0d8a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:03.190752 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e8d19aa4-6ed3-4b8d-b96b-fafb1a2f0d8a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:03.191200 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e8d19aa4-6ed3-4b8d-b96b-fafb1a2f0d8a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:03.340679 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-e8d19aa4-6ed3-4b8d-b96b-fafb1a2f0d8a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:03.350986 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-e8d19aa4-6ed3-4b8d-b96b-fafb1a2f0d8a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:03.352541 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-e8d19aa4-6ed3-4b8d-b96b-fafb1a2f0d8a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:03.353869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-e8d19aa4-6ed3-4b8d-b96b-fafb1a2f0d8a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1671 microversion: 2.20 time: 0.176883 Aug 02 09:17:03.355181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 383/747] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:03 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1671 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:04.380752 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-d0dc2a57-215c-4394-b7c5-8d6dfb148887 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:04.381373 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-d0dc2a57-215c-4394-b7c5-8d6dfb148887 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:04.387890 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d0dc2a57-215c-4394-b7c5-8d6dfb148887 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:04.388553 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d0dc2a57-215c-4394-b7c5-8d6dfb148887 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:04.389437 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d0dc2a57-215c-4394-b7c5-8d6dfb148887 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:04.390081 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d0dc2a57-215c-4394-b7c5-8d6dfb148887 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:04.538900 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-d0dc2a57-215c-4394-b7c5-8d6dfb148887 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:04.547435 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-d0dc2a57-215c-4394-b7c5-8d6dfb148887 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:04.548979 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-d0dc2a57-215c-4394-b7c5-8d6dfb148887 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:04.550158 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-d0dc2a57-215c-4394-b7c5-8d6dfb148887 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1671 microversion: 2.20 time: 0.174664 Aug 02 09:17:04.550740 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 365/748] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:04 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1671 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:05.574069 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-0d14bafd-4f48-4a30-b461-3c40c014b370 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:05.574628 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-0d14bafd-4f48-4a30-b461-3c40c014b370 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:05.577006 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:05.581910 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0d14bafd-4f48-4a30-b461-3c40c014b370 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:05.582971 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0d14bafd-4f48-4a30-b461-3c40c014b370 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:05.583897 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0d14bafd-4f48-4a30-b461-3c40c014b370 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:05.584404 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0d14bafd-4f48-4a30-b461-3c40c014b370 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:05.735407 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-0d14bafd-4f48-4a30-b461-3c40c014b370 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:05.745128 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-0d14bafd-4f48-4a30-b461-3c40c014b370 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:05.746652 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-0d14bafd-4f48-4a30-b461-3c40c014b370 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:05.747840 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-0d14bafd-4f48-4a30-b461-3c40c014b370 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1729 microversion: 2.20 time: 0.178093 Aug 02 09:17:05.748437 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 384/749] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:05 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:06.772729 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-4205ccc1-c6ba-4547-85be-97ccebb88c12 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:06.773646 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-4205ccc1-c6ba-4547-85be-97ccebb88c12 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:06.785546 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4205ccc1-c6ba-4547-85be-97ccebb88c12 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:06.785546 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4205ccc1-c6ba-4547-85be-97ccebb88c12 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:06.785546 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4205ccc1-c6ba-4547-85be-97ccebb88c12 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:06.785546 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4205ccc1-c6ba-4547-85be-97ccebb88c12 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:06.956098 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-4205ccc1-c6ba-4547-85be-97ccebb88c12 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:06.966101 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-4205ccc1-c6ba-4547-85be-97ccebb88c12 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:06.967120 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-4205ccc1-c6ba-4547-85be-97ccebb88c12 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:06.968645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-4205ccc1-c6ba-4547-85be-97ccebb88c12 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1729 microversion: 2.20 time: 0.199836 Aug 02 09:17:06.969320 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 366/750] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:06 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1729 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:07.995814 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-01c5d7b1-7065-4a97-acab-ac0d4da2d87c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:07.996635 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-01c5d7b1-7065-4a97-acab-ac0d4da2d87c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:08.003308 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-01c5d7b1-7065-4a97-acab-ac0d4da2d87c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:08.003748 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-01c5d7b1-7065-4a97-acab-ac0d4da2d87c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:08.004557 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-01c5d7b1-7065-4a97-acab-ac0d4da2d87c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:08.004983 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-01c5d7b1-7065-4a97-acab-ac0d4da2d87c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:08.200746 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-01c5d7b1-7065-4a97-acab-ac0d4da2d87c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:08.210521 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-01c5d7b1-7065-4a97-acab-ac0d4da2d87c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:08.221258 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-01c5d7b1-7065-4a97-acab-ac0d4da2d87c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:08.223122 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-01c5d7b1-7065-4a97-acab-ac0d4da2d87c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1729 microversion: 2.20 time: 0.232217 Aug 02 09:17:08.224043 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 385/751] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:07 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1729 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:17:09.252481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-6767427d-c3ce-4f02-92f6-083195743b2b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:09.253220 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-6767427d-c3ce-4f02-92f6-083195743b2b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:09.261712 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6767427d-c3ce-4f02-92f6-083195743b2b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:09.262403 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6767427d-c3ce-4f02-92f6-083195743b2b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:09.263267 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6767427d-c3ce-4f02-92f6-083195743b2b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:09.263929 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6767427d-c3ce-4f02-92f6-083195743b2b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:09.458457 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-6767427d-c3ce-4f02-92f6-083195743b2b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:09.474385 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-6767427d-c3ce-4f02-92f6-083195743b2b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:09.478314 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-6767427d-c3ce-4f02-92f6-083195743b2b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:09.481168 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-6767427d-c3ce-4f02-92f6-083195743b2b tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1729 microversion: 2.20 time: 0.233163 Aug 02 09:17:09.488475 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 367/752] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:09 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1729 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:10.520563 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-fdf6ebcb-51c2-4f89-be8e-7248363e7cce tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:10.523014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-fdf6ebcb-51c2-4f89-be8e-7248363e7cce tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:10.536075 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fdf6ebcb-51c2-4f89-be8e-7248363e7cce tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:10.537254 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fdf6ebcb-51c2-4f89-be8e-7248363e7cce tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:10.538954 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fdf6ebcb-51c2-4f89-be8e-7248363e7cce tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:10.540256 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fdf6ebcb-51c2-4f89-be8e-7248363e7cce tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:10.739684 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-fdf6ebcb-51c2-4f89-be8e-7248363e7cce tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:10.749688 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-fdf6ebcb-51c2-4f89-be8e-7248363e7cce tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:10.751462 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-fdf6ebcb-51c2-4f89-be8e-7248363e7cce tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:10.752554 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-fdf6ebcb-51c2-4f89-be8e-7248363e7cce tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1729 microversion: 2.20 time: 0.241123 Aug 02 09:17:10.769293 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 386/753] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:10 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1729 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:11.777069 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-9f82b0aa-680b-414d-8b28-0c475c447717 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:11.777861 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-9f82b0aa-680b-414d-8b28-0c475c447717 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:11.785093 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9f82b0aa-680b-414d-8b28-0c475c447717 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:11.785545 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9f82b0aa-680b-414d-8b28-0c475c447717 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:11.787239 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9f82b0aa-680b-414d-8b28-0c475c447717 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:11.788016 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9f82b0aa-680b-414d-8b28-0c475c447717 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:11.951214 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-9f82b0aa-680b-414d-8b28-0c475c447717 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:11.960492 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-9f82b0aa-680b-414d-8b28-0c475c447717 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:11.961986 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-9f82b0aa-680b-414d-8b28-0c475c447717 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:11.963155 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-9f82b0aa-680b-414d-8b28-0c475c447717 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1729 microversion: 2.20 time: 0.190271 Aug 02 09:17:11.963720 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 368/754] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:11 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1729 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:12.989259 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-616c70af-c6a0-4371-a81c-f0955e38706f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:12.990709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-616c70af-c6a0-4371-a81c-f0955e38706f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:13.002269 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-616c70af-c6a0-4371-a81c-f0955e38706f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:13.002716 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-616c70af-c6a0-4371-a81c-f0955e38706f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:13.005984 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-616c70af-c6a0-4371-a81c-f0955e38706f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:13.006631 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-616c70af-c6a0-4371-a81c-f0955e38706f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:13.214066 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-616c70af-c6a0-4371-a81c-f0955e38706f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:13.224122 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-616c70af-c6a0-4371-a81c-f0955e38706f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:13.226142 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-616c70af-c6a0-4371-a81c-f0955e38706f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:13.227480 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-616c70af-c6a0-4371-a81c-f0955e38706f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1729 microversion: 2.20 time: 0.243502 Aug 02 09:17:13.232299 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 387/755] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:12 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1729 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:14.256826 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-03d4dd96-505e-49ef-b9bf-540fa41cb45f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:14.258374 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-03d4dd96-505e-49ef-b9bf-540fa41cb45f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:14.278490 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-03d4dd96-505e-49ef-b9bf-540fa41cb45f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:14.280834 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-03d4dd96-505e-49ef-b9bf-540fa41cb45f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:14.281976 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-03d4dd96-505e-49ef-b9bf-540fa41cb45f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:14.285887 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-03d4dd96-505e-49ef-b9bf-540fa41cb45f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:14.323369 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:14.527569 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-03d4dd96-505e-49ef-b9bf-540fa41cb45f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:14.539664 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-03d4dd96-505e-49ef-b9bf-540fa41cb45f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:14.541379 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-03d4dd96-505e-49ef-b9bf-540fa41cb45f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:14.542601 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-03d4dd96-505e-49ef-b9bf-540fa41cb45f tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1729 microversion: 2.20 time: 0.290233 Aug 02 09:17:14.543153 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 369/756] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:14 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1729 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:15.568917 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-3eec3558-80e0-4aa1-8d13-03995a77ee56 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:15.569538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-3eec3558-80e0-4aa1-8d13-03995a77ee56 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:15.576660 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3eec3558-80e0-4aa1-8d13-03995a77ee56 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:15.577103 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3eec3558-80e0-4aa1-8d13-03995a77ee56 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:15.577875 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3eec3558-80e0-4aa1-8d13-03995a77ee56 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:15.578304 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3eec3558-80e0-4aa1-8d13-03995a77ee56 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:15.731153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-3eec3558-80e0-4aa1-8d13-03995a77ee56 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:15.741030 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-3eec3558-80e0-4aa1-8d13-03995a77ee56 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:15.742775 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-3eec3558-80e0-4aa1-8d13-03995a77ee56 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:15.744119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-3eec3558-80e0-4aa1-8d13-03995a77ee56 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1729 microversion: 2.20 time: 0.179778 Aug 02 09:17:15.744814 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 388/757] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:15 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:16.769116 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-4232cd88-19fa-4f13-a1ea-b9bf89f3c04a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:16.769789 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-4232cd88-19fa-4f13-a1ea-b9bf89f3c04a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:16.777086 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4232cd88-19fa-4f13-a1ea-b9bf89f3c04a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:16.777533 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4232cd88-19fa-4f13-a1ea-b9bf89f3c04a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:16.778314 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4232cd88-19fa-4f13-a1ea-b9bf89f3c04a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:16.778774 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4232cd88-19fa-4f13-a1ea-b9bf89f3c04a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:16.931377 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-4232cd88-19fa-4f13-a1ea-b9bf89f3c04a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:16.941156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-4232cd88-19fa-4f13-a1ea-b9bf89f3c04a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:16.943467 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-4232cd88-19fa-4f13-a1ea-b9bf89f3c04a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:16.944902 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-4232cd88-19fa-4f13-a1ea-b9bf89f3c04a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1729 microversion: 2.20 time: 0.179858 Aug 02 09:17:16.945567 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 370/758] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:16 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:17.969826 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-55dcc2cb-0bae-4462-9aa5-601f85489b01 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:17.970719 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-55dcc2cb-0bae-4462-9aa5-601f85489b01 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:17.978632 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-55dcc2cb-0bae-4462-9aa5-601f85489b01 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:17.979132 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-55dcc2cb-0bae-4462-9aa5-601f85489b01 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:17.979856 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-55dcc2cb-0bae-4462-9aa5-601f85489b01 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:17.980318 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-55dcc2cb-0bae-4462-9aa5-601f85489b01 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:18.138718 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-55dcc2cb-0bae-4462-9aa5-601f85489b01 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:18.147799 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-55dcc2cb-0bae-4462-9aa5-601f85489b01 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:18.149414 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-55dcc2cb-0bae-4462-9aa5-601f85489b01 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:18.150641 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-55dcc2cb-0bae-4462-9aa5-601f85489b01 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1729 microversion: 2.20 time: 0.184850 Aug 02 09:17:18.151214 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 389/759] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:17 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:17:19.175273 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-3478c10a-68a9-41fa-8103-0c803a450cf5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:19.175963 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-3478c10a-68a9-41fa-8103-0c803a450cf5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:19.183346 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3478c10a-68a9-41fa-8103-0c803a450cf5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:19.183789 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3478c10a-68a9-41fa-8103-0c803a450cf5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:19.184612 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3478c10a-68a9-41fa-8103-0c803a450cf5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:19.185043 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3478c10a-68a9-41fa-8103-0c803a450cf5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:19.405764 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-3478c10a-68a9-41fa-8103-0c803a450cf5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:19.415510 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-3478c10a-68a9-41fa-8103-0c803a450cf5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:19.417078 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-3478c10a-68a9-41fa-8103-0c803a450cf5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:19.418295 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-3478c10a-68a9-41fa-8103-0c803a450cf5 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1729 microversion: 2.20 time: 0.247191 Aug 02 09:17:19.418861 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 371/760] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:19 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1729 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:20.445376 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-41bbb783-0dea-4548-9df3-c7702216fc48 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:20.446360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-41bbb783-0dea-4548-9df3-c7702216fc48 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:20.455668 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-41bbb783-0dea-4548-9df3-c7702216fc48 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:20.456129 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-41bbb783-0dea-4548-9df3-c7702216fc48 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:20.456958 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-41bbb783-0dea-4548-9df3-c7702216fc48 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:20.457396 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-41bbb783-0dea-4548-9df3-c7702216fc48 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:20.623427 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-41bbb783-0dea-4548-9df3-c7702216fc48 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:20.632546 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-41bbb783-0dea-4548-9df3-c7702216fc48 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:20.634101 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-41bbb783-0dea-4548-9df3-c7702216fc48 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:20.635294 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-41bbb783-0dea-4548-9df3-c7702216fc48 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1729 microversion: 2.20 time: 0.195793 Aug 02 09:17:20.635859 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 390/761] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:20 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1729 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:21.660351 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-2dc12fb5-4637-4cfd-a70c-e6184e1945a6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:21.660957 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-2dc12fb5-4637-4cfd-a70c-e6184e1945a6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:21.668514 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2dc12fb5-4637-4cfd-a70c-e6184e1945a6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:21.669100 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2dc12fb5-4637-4cfd-a70c-e6184e1945a6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:21.673629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2dc12fb5-4637-4cfd-a70c-e6184e1945a6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:21.673629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-2dc12fb5-4637-4cfd-a70c-e6184e1945a6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:21.831442 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-2dc12fb5-4637-4cfd-a70c-e6184e1945a6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:21.831442 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-2dc12fb5-4637-4cfd-a70c-e6184e1945a6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:21.831849 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-2dc12fb5-4637-4cfd-a70c-e6184e1945a6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:21.831849 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-2dc12fb5-4637-4cfd-a70c-e6184e1945a6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1729 microversion: 2.20 time: 0.169260 Aug 02 09:17:21.831849 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 372/762] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:21 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:22.867739 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-5d32cf6c-0491-4ffd-adea-5f6e9f51e70a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:22.868380 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-5d32cf6c-0491-4ffd-adea-5f6e9f51e70a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:22.875102 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5d32cf6c-0491-4ffd-adea-5f6e9f51e70a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:22.875451 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5d32cf6c-0491-4ffd-adea-5f6e9f51e70a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:22.877730 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5d32cf6c-0491-4ffd-adea-5f6e9f51e70a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:22.877730 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5d32cf6c-0491-4ffd-adea-5f6e9f51e70a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:23.029439 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-5d32cf6c-0491-4ffd-adea-5f6e9f51e70a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:23.038978 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-5d32cf6c-0491-4ffd-adea-5f6e9f51e70a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:23.040576 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-5d32cf6c-0491-4ffd-adea-5f6e9f51e70a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:23.041822 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-5d32cf6c-0491-4ffd-adea-5f6e9f51e70a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1729 microversion: 2.20 time: 0.178117 Aug 02 09:17:23.042390 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 391/763] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:22 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:23.163463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-7f2e6fa3-44ab-4e3c-879d-a05a2405bfa4 req-dae4020c-72fe-4c3c-bd45-cf20068a538d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b54fded6-ca19-48e6-b971-31f061cce0c5", "name": "network-vif-plugged", "status": "completed", "tag": "021d8483-0afc-44b7-b117-6f61fcf5696d"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:17:23.176080 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-7f2e6fa3-44ab-4e3c-879d-a05a2405bfa4 req-dae4020c-72fe-4c3c-bd45-cf20068a538d service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:23.177257 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-7f2e6fa3-44ab-4e3c-879d-a05a2405bfa4 req-dae4020c-72fe-4c3c-bd45-cf20068a538d service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:23.191653 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-7f2e6fa3-44ab-4e3c-879d-a05a2405bfa4 req-dae4020c-72fe-4c3c-bd45-cf20068a538d service nova] Creating event network-vif-plugged:021d8483-0afc-44b7-b117-6f61fcf5696d for instance b54fded6-ca19-48e6-b971-31f061cce0c5 on hv-cinder-84599 Aug 02 09:17:23.199182 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-7f2e6fa3-44ab-4e3c-879d-a05a2405bfa4 req-dae4020c-72fe-4c3c-bd45-cf20068a538d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041425 Aug 02 09:17:23.203900 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 373/764] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:17:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:24.065036 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-1b0e0f08-f902-4c72-b530-22908793c9d2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:24.065036 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-1b0e0f08-f902-4c72-b530-22908793c9d2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:24.073018 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1b0e0f08-f902-4c72-b530-22908793c9d2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:24.073474 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1b0e0f08-f902-4c72-b530-22908793c9d2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:24.074255 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1b0e0f08-f902-4c72-b530-22908793c9d2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:24.074699 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1b0e0f08-f902-4c72-b530-22908793c9d2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:24.091270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:24.249926 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-1b0e0f08-f902-4c72-b530-22908793c9d2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:24.263570 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-1b0e0f08-f902-4c72-b530-22908793c9d2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:24.265341 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-1b0e0f08-f902-4c72-b530-22908793c9d2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:24.266557 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-1b0e0f08-f902-4c72-b530-22908793c9d2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1729 microversion: 2.20 time: 0.205480 Aug 02 09:17:24.289077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 392/765] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:24 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:25.293274 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-6b72ec6a-4af3-419e-b246-7350f29cb1f2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:25.294391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-6b72ec6a-4af3-419e-b246-7350f29cb1f2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:25.297626 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=28 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:25.304616 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6b72ec6a-4af3-419e-b246-7350f29cb1f2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:25.305153 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6b72ec6a-4af3-419e-b246-7350f29cb1f2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:25.312403 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6b72ec6a-4af3-419e-b246-7350f29cb1f2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:25.312403 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6b72ec6a-4af3-419e-b246-7350f29cb1f2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:25.488853 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-6b72ec6a-4af3-419e-b246-7350f29cb1f2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:25.506428 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-6b72ec6a-4af3-419e-b246-7350f29cb1f2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:25.509815 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-6b72ec6a-4af3-419e-b246-7350f29cb1f2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:25.511998 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-6b72ec6a-4af3-419e-b246-7350f29cb1f2 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1729 microversion: 2.20 time: 0.223490 Aug 02 09:17:25.513042 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 374/766] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:25 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:26.535248 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-2b905dcf-cb54-4a78-a199-c1ffed524abf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:26.535894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-2b905dcf-cb54-4a78-a199-c1ffed524abf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:26.543571 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2b905dcf-cb54-4a78-a199-c1ffed524abf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:26.544022 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2b905dcf-cb54-4a78-a199-c1ffed524abf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:26.544866 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2b905dcf-cb54-4a78-a199-c1ffed524abf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:26.545300 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2b905dcf-cb54-4a78-a199-c1ffed524abf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:26.699618 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-2b905dcf-cb54-4a78-a199-c1ffed524abf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:26.709020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-2b905dcf-cb54-4a78-a199-c1ffed524abf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:26.711955 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-2b905dcf-cb54-4a78-a199-c1ffed524abf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:26.713267 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-2b905dcf-cb54-4a78-a199-c1ffed524abf tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1729 microversion: 2.20 time: 0.182123 Aug 02 09:17:26.727970 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 393/767] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:26 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:17:27.738075 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-9b044b3f-b816-4cd3-a3f6-1c6a3ce5bc2d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:27.739574 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-9b044b3f-b816-4cd3-a3f6-1c6a3ce5bc2d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:27.746799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9b044b3f-b816-4cd3-a3f6-1c6a3ce5bc2d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:27.747250 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9b044b3f-b816-4cd3-a3f6-1c6a3ce5bc2d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:27.748029 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9b044b3f-b816-4cd3-a3f6-1c6a3ce5bc2d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:27.748506 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9b044b3f-b816-4cd3-a3f6-1c6a3ce5bc2d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:27.932624 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-9b044b3f-b816-4cd3-a3f6-1c6a3ce5bc2d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:27.947125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-9b044b3f-b816-4cd3-a3f6-1c6a3ce5bc2d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:27.948969 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-9b044b3f-b816-4cd3-a3f6-1c6a3ce5bc2d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:27.950201 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-9b044b3f-b816-4cd3-a3f6-1c6a3ce5bc2d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1716 microversion: 2.20 time: 0.216240 Aug 02 09:17:27.950768 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 375/768] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:17:27 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1716 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 02 09:17:33.619448 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-b9bf87bb-767d-4d01-b305-6a33d2d83056 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:33.620119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-b9bf87bb-767d-4d01-b305-6a33d2d83056 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:33.626990 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b9bf87bb-767d-4d01-b305-6a33d2d83056 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:33.627807 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b9bf87bb-767d-4d01-b305-6a33d2d83056 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:33.628888 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b9bf87bb-767d-4d01-b305-6a33d2d83056 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:33.630605 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b9bf87bb-767d-4d01-b305-6a33d2d83056 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:33.660123 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-b9bf87bb-767d-4d01-b305-6a33d2d83056 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/ips" status: 200 len: 143 microversion: 2.1 time: 0.252774 Aug 02 09:17:33.662827 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 394/769] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 2 09:17:33 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/ips => generated 143 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:35.470547 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c465f0b9-decb-4407-ab92-ad1473ae2d89 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1eee8e56-6c58-4064-87ea-e4422eaf1e99"}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:17:35.473667 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-c465f0b9-decb-4407-ab92-ad1473ae2d89 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:35.481092 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c465f0b9-decb-4407-ab92-ad1473ae2d89 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:35.481731 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c465f0b9-decb-4407-ab92-ad1473ae2d89 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:35.482686 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c465f0b9-decb-4407-ab92-ad1473ae2d89 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:35.483088 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c465f0b9-decb-4407-ab92-ad1473ae2d89 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:35.661397 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-78045061-16e0-4f3f-a7c0-388014743bf4 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:35.662353 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-78045061-16e0-4f3f-a7c0-388014743bf4 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:35.664319 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=22 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:35.669219 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-78045061-16e0-4f3f-a7c0-388014743bf4 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:35.669660 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-78045061-16e0-4f3f-a7c0-388014743bf4 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:35.670618 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-78045061-16e0-4f3f-a7c0-388014743bf4 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:35.671137 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-78045061-16e0-4f3f-a7c0-388014743bf4 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:35.696094 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-78045061-16e0-4f3f-a7c0-388014743bf4 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/ips" status: 200 len: 150 microversion: 2.1 time: 0.038956 Aug 02 09:17:35.696712 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 395/770] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 2 09:17:35 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:36.555752 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-c465f0b9-decb-4407-ab92-ad1473ae2d89 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "POST /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.089273 Aug 02 09:17:36.556962 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 376/771] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 2 09:17:35 2022] POST /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/os-volume_attachments => generated 194 bytes in 1092 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:38.106249 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4059256c-5715-4949-b5ba-a09a42ed83a7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dcb80b4e-e337-43fa-904b-44096691600e"}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:17:38.114754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-4059256c-5715-4949-b5ba-a09a42ed83a7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:38.118964 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4059256c-5715-4949-b5ba-a09a42ed83a7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:38.119670 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4059256c-5715-4949-b5ba-a09a42ed83a7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:38.120813 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4059256c-5715-4949-b5ba-a09a42ed83a7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:38.121395 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4059256c-5715-4949-b5ba-a09a42ed83a7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:39.236960 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-4059256c-5715-4949-b5ba-a09a42ed83a7 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "POST /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.135836 Aug 02 09:17:39.237647 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 396/772] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 2 09:17:38 2022] POST /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments => generated 194 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:41.766940 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-727219d0-7256-4806-9fda-09e22f7cb1e6 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:41.767661 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-727219d0-7256-4806-9fda-09e22f7cb1e6 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:41.774554 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-727219d0-7256-4806-9fda-09e22f7cb1e6 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:41.775005 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-727219d0-7256-4806-9fda-09e22f7cb1e6 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:41.775794 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-727219d0-7256-4806-9fda-09e22f7cb1e6 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:41.776245 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-727219d0-7256-4806-9fda-09e22f7cb1e6 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:41.802295 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-727219d0-7256-4806-9fda-09e22f7cb1e6 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Going to try to terminate instance {{(pid=118526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:17:42.129845 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-727219d0-7256-4806-9fda-09e22f7cb1e6 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 204 len: 0 microversion: 2.1 time: 0.367444 Aug 02 09:17:42.137332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 377/773] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:17:41 2022] DELETE /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:17:42.149331 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-610cc819-58c9-4f31-b150-bd637f9f1fb2 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:42.150024 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-610cc819-58c9-4f31-b150-bd637f9f1fb2 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:42.157184 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-610cc819-58c9-4f31-b150-bd637f9f1fb2 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:42.157630 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-610cc819-58c9-4f31-b150-bd637f9f1fb2 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:42.158434 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-610cc819-58c9-4f31-b150-bd637f9f1fb2 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:42.158866 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-610cc819-58c9-4f31-b150-bd637f9f1fb2 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:42.320069 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-610cc819-58c9-4f31-b150-bd637f9f1fb2 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:42.329399 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-610cc819-58c9-4f31-b150-bd637f9f1fb2 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 200 len: 1580 microversion: 2.1 time: 0.184763 Aug 02 09:17:42.330109 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 397/774] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:42 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 1580 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:43.353989 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-f11e93f7-e5fa-4bc0-ab6b-475091417521 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:43.354767 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-f11e93f7-e5fa-4bc0-ab6b-475091417521 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:43.361842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f11e93f7-e5fa-4bc0-ab6b-475091417521 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:43.362295 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f11e93f7-e5fa-4bc0-ab6b-475091417521 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:43.363079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f11e93f7-e5fa-4bc0-ab6b-475091417521 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:43.363520 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f11e93f7-e5fa-4bc0-ab6b-475091417521 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:43.540084 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-f11e93f7-e5fa-4bc0-ab6b-475091417521 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:43.548984 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-f11e93f7-e5fa-4bc0-ab6b-475091417521 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 200 len: 1580 microversion: 2.1 time: 0.199649 Aug 02 09:17:43.555822 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 378/775] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:43 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 1580 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:44.581076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-edae9744-f3d0-4568-b172-ae37f95d9d60 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:44.581980 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-edae9744-f3d0-4568-b172-ae37f95d9d60 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:44.592229 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-edae9744-f3d0-4568-b172-ae37f95d9d60 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:44.593125 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-edae9744-f3d0-4568-b172-ae37f95d9d60 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:44.594605 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-edae9744-f3d0-4568-b172-ae37f95d9d60 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:44.595399 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-edae9744-f3d0-4568-b172-ae37f95d9d60 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:44.870293 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-edae9744-f3d0-4568-b172-ae37f95d9d60 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:44.880141 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-edae9744-f3d0-4568-b172-ae37f95d9d60 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 200 len: 1580 microversion: 2.1 time: 0.311906 Aug 02 09:17:44.883136 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 398/776] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:44 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 1580 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:45.464349 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-39f3e7f5-adfa-4e1b-b9cd-0397f60e51d4 req-0bd8c192-c77d-4a2c-b635-dba1e14578cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cee14a35-0425-48c3-9e4e-efed2fdd23a1", "name": "network-vif-deleted", "tag": "99bf6922-c8df-418b-91be-5f5d1aeea287"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:17:45.464349 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-39f3e7f5-adfa-4e1b-b9cd-0397f60e51d4 req-0bd8c192-c77d-4a2c-b635-dba1e14578cd service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:45.464349 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-39f3e7f5-adfa-4e1b-b9cd-0397f60e51d4 req-0bd8c192-c77d-4a2c-b635-dba1e14578cd service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:45.464349 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-39f3e7f5-adfa-4e1b-b9cd-0397f60e51d4 req-0bd8c192-c77d-4a2c-b635-dba1e14578cd service nova] Creating event network-vif-deleted:99bf6922-c8df-418b-91be-5f5d1aeea287 for instance cee14a35-0425-48c3-9e4e-efed2fdd23a1 on hv-cinder-84599 Aug 02 09:17:45.506425 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-39f3e7f5-adfa-4e1b-b9cd-0397f60e51d4 req-0bd8c192-c77d-4a2c-b635-dba1e14578cd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038040 Aug 02 09:17:45.506425 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 379/777] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:17:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:45.906889 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-f8ef2e70-473d-4639-9c93-8f34d183826f tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:45.908312 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-f8ef2e70-473d-4639-9c93-8f34d183826f tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:45.917492 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f8ef2e70-473d-4639-9c93-8f34d183826f tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:45.921626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f8ef2e70-473d-4639-9c93-8f34d183826f tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:45.921626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f8ef2e70-473d-4639-9c93-8f34d183826f tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:45.921626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f8ef2e70-473d-4639-9c93-8f34d183826f tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:46.031511 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-f8ef2e70-473d-4639-9c93-8f34d183826f tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:46.044317 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-f8ef2e70-473d-4639-9c93-8f34d183826f tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 200 len: 1226 microversion: 2.1 time: 0.143203 Aug 02 09:17:46.045114 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 399/778] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:45 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 1226 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:46.189198 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-6cf1f114-ece4-4fcf-8f6b-8a9138f84c96 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:46.191535 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-6cf1f114-ece4-4fcf-8f6b-8a9138f84c96 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:46.200340 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6cf1f114-ece4-4fcf-8f6b-8a9138f84c96 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:46.201067 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6cf1f114-ece4-4fcf-8f6b-8a9138f84c96 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:46.201850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6cf1f114-ece4-4fcf-8f6b-8a9138f84c96 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:46.202288 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6cf1f114-ece4-4fcf-8f6b-8a9138f84c96 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:46.238297 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-6cf1f114-ece4-4fcf-8f6b-8a9138f84c96 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052036 Aug 02 09:17:46.238297 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 380/779] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:17:46 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:46.248524 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-6f6b45db-9ee8-4b53-b611-7d8f7e3828fd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:46.249307 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-6f6b45db-9ee8-4b53-b611-7d8f7e3828fd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:46.255471 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6f6b45db-9ee8-4b53-b611-7d8f7e3828fd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:46.256040 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6f6b45db-9ee8-4b53-b611-7d8f7e3828fd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:46.256958 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6f6b45db-9ee8-4b53-b611-7d8f7e3828fd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:46.257393 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6f6b45db-9ee8-4b53-b611-7d8f7e3828fd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:46.290047 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-6f6b45db-9ee8-4b53-b611-7d8f7e3828fd tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/os-volume_attachments/1eee8e56-6c58-4064-87ea-e4422eaf1e99" status: 200 len: 194 microversion: 2.1 time: 0.045493 Aug 02 09:17:46.290670 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 400/780] 10.222.0.20 () {58 vars in 1413 bytes} [Tue Aug 2 09:17:46 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/os-volume_attachments/1eee8e56-6c58-4064-87ea-e4422eaf1e99 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:47.078180 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-feaf60fd-4b02-4e5c-aef5-6b693ca5e07d tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:47.078802 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-feaf60fd-4b02-4e5c-aef5-6b693ca5e07d tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:47.097681 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-feaf60fd-4b02-4e5c-aef5-6b693ca5e07d tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:47.098218 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-feaf60fd-4b02-4e5c-aef5-6b693ca5e07d tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:47.099019 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-feaf60fd-4b02-4e5c-aef5-6b693ca5e07d tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:47.099984 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-feaf60fd-4b02-4e5c-aef5-6b693ca5e07d tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:47.110885 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:47.162315 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-feaf60fd-4b02-4e5c-aef5-6b693ca5e07d tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:47.163554 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-feaf60fd-4b02-4e5c-aef5-6b693ca5e07d tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:47.164800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.objects.instance [None req-feaf60fd-4b02-4e5c-aef5-6b693ca5e07d tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lazy-loading 'fault' on Instance uuid cee14a35-0425-48c3-9e4e-efed2fdd23a1 {{(pid=118526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:17:47.244062 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-feaf60fd-4b02-4e5c-aef5-6b693ca5e07d tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:47.257507 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-feaf60fd-4b02-4e5c-aef5-6b693ca5e07d tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 200 len: 1231 microversion: 2.1 time: 0.191490 Aug 02 09:17:47.260620 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 381/781] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:47 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 1231 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:48.248704 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-20570d4c-4380-4c5c-99cb-64dc1320ac8e tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ce3c1342-9c8a-4c9e-bd48-7ab0458ea8bb"}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:17:48.251158 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-20570d4c-4380-4c5c-99cb-64dc1320ac8e tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:48.261332 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-20570d4c-4380-4c5c-99cb-64dc1320ac8e tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:48.261332 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-20570d4c-4380-4c5c-99cb-64dc1320ac8e tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:48.261765 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-20570d4c-4380-4c5c-99cb-64dc1320ac8e tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:48.262295 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-20570d4c-4380-4c5c-99cb-64dc1320ac8e tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:48.290255 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-89f35c35-403b-4fdb-95fc-9117cb03f223 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:48.291522 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-89f35c35-403b-4fdb-95fc-9117cb03f223 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:48.300658 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-89f35c35-403b-4fdb-95fc-9117cb03f223 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:48.301413 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-89f35c35-403b-4fdb-95fc-9117cb03f223 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:48.303022 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-89f35c35-403b-4fdb-95fc-9117cb03f223 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:48.303889 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-89f35c35-403b-4fdb-95fc-9117cb03f223 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:48.320964 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-89f35c35-403b-4fdb-95fc-9117cb03f223 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] HTTP exception thrown: Instance cee14a35-0425-48c3-9e4e-efed2fdd23a1 could not be found. Aug 02 09:17:48.323629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-89f35c35-403b-4fdb-95fc-9117cb03f223 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Request method failure captured: Aug 02 09:17:48.323629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 HTTP/1.1 Aug 02 09:17:48.323629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:17:48.323629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:17:48.323629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:17:48.323629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:17:48.323629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:17:48.323629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:17:48.323629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:17:48.323629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:17:48.323629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6Or9j-cQzxFAAB1xBmv_bY_mRvljzv7nsSioCNaI1OGnkB6STrdlAlH5TAjtrlpHrQIu9d8A2YEEmh2wzTuRN7Vb6j4uWiaX0a2HO94lGUsCKCZWP7V0SJXCiQV2Lh4Rtd7IJx4Pp0WLja2tbiIhH3e67gkC1faskQi8YHy99F0xJQ0 Aug 02 09:17:48.323629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:17:48.323629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:17:48.323629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:17:48.323629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:17:48.323629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:17:48.323629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:17:48.323629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: 8e8d4b340fc54e639758d911a5ab16a7 Aug 02 09:17:48.323629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-TestVolumeBootPattern-657612348 Aug 02 09:17:48.323629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:17:48.323629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:17:48.335041 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8e8d4b340fc54e639758d911a5ab16a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8e8d4b340fc54e639758d911a5ab16a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8e8d4b340fc54e639758d911a5ab16a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8e8d4b340fc54e639758d911a5ab16a7"}]}] Aug 02 09:17:48.335041 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-TestVolumeBootPattern-657612348 Aug 02 09:17:48.335041 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: 8e8d4b340fc54e639758d911a5ab16a7 Aug 02 09:17:48.335041 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-TestVolumeBootPattern-657612348 Aug 02 09:17:48.335041 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-TestVolumeBootPattern-657612348-project Aug 02 09:17:48.335041 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:17:48.335041 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:17:48.335041 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: c0a2b49114e0458f9625de698cc89861 Aug 02 09:17:48.335041 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-TestVolumeBootPattern-657612348-project Aug 02 09:17:48.335041 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:17:48.335041 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Instance cee14a35-0425-48c3-9e4e-efed2fdd23a1 could not be found. Aug 02 09:17:48.335041 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'id': 'cee14a35-0425-48c3-9e4e-efed2fdd23a1'} Aug 02 09:17:48.335850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:17:48.335850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:17:48.335850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:17:48.335850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:17:48.335850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:17:48.335850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:17:48.335850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:17:48.335850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:17:48.335850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:17:48.335850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:17:48.335850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cee14a35-0425-48c3-9e4e-efed2fdd23a1 could not be found. Aug 02 09:17:48.335850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:17:48.335850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:17:48.335850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:17:48.335850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:17:48.335850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:17:48.335850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:17:48.335850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:17:48.335850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:17:48.335850 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:17:48.341061 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:17:48.341061 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:17:48.341061 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:17:48.341061 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:17:48.341061 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:17:48.341061 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:17:48.341061 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:17:48.341061 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cee14a35-0425-48c3-9e4e-efed2fdd23a1 could not be found. Aug 02 09:17:48.341061 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:17:48.341061 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:17:48.341061 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:17:48.341061 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:17:48.341061 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:17:48.341061 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:17:48.341061 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:17:48.341061 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:17:48.341061 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cee14a35-0425-48c3-9e4e-efed2fdd23a1 could not be found. Aug 02 09:17:48.341061 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:17:48.350548 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-89f35c35-403b-4fdb-95fc-9117cb03f223 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Returning 404 to user: Instance cee14a35-0425-48c3-9e4e-efed2fdd23a1 could not be found. {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:17:48.350548 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-89f35c35-403b-4fdb-95fc-9117cb03f223 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 404 len: 111 microversion: 2.1 time: 0.047748 Aug 02 09:17:48.350548 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 382/782] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:48 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:17:48.473576 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-15806e7f-ca18-4225-8139-871d4daddd86 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1055762542", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1068068850", "security_groups": [{"name": "tempest-secgroup-smoke-1032874180"}], "block_device_mapping_v2": [{"uuid": "741241e0-37d7-4473-a6dd-e9f16becfc12", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "591148ac-b480-44cf-8cb3-9d42c0440114"}]}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:17:48.603635 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.network.neutron [None req-15806e7f-ca18-4225-8139-871d4daddd86 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] validate_networks() for [('591148ac-b480-44cf-8cb3-9d42c0440114', None, None, None, None, None)] {{(pid=118526) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:17:49.042057 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-15806e7f-ca18-4225-8139-871d4daddd86 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Flavor limits 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:17:49.042734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-15806e7f-ca18-4225-8139-871d4daddd86 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Image limits 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:17:49.043365 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-15806e7f-ca18-4225-8139-871d4daddd86 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Flavor pref 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:17:49.043942 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-15806e7f-ca18-4225-8139-871d4daddd86 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Image pref 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:17:49.044398 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-15806e7f-ca18-4225-8139-871d4daddd86 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:17:49.053564 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-15806e7f-ca18-4225-8139-871d4daddd86 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:49.054014 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-15806e7f-ca18-4225-8139-871d4daddd86 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:49.054815 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-15806e7f-ca18-4225-8139-871d4daddd86 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:49.055381 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-15806e7f-ca18-4225-8139-871d4daddd86 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:49.075482 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-15806e7f-ca18-4225-8139-871d4daddd86 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Getting quotas for project 8e8d4b340fc54e639758d911a5ab16a7. Resources: {'cores', 'ram', 'instances'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:17:49.085513 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-15806e7f-ca18-4225-8139-871d4daddd86 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Getting quotas for user c0a2b49114e0458f9625de698cc89861 and project 8e8d4b340fc54e639758d911a5ab16a7. Resources: {'cores', 'ram', 'instances'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:17:49.166661 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-15806e7f-ca18-4225-8139-871d4daddd86 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Going to run 1 instances... {{(pid=118526) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:17:49.166940 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-15806e7f-ca18-4225-8139-871d4daddd86 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='741241e0-37d7-4473-a6dd-e9f16becfc12',volume_size=None,volume_type=None)] {{(pid=118526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:17:49.316063 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-20570d4c-4380-4c5c-99cb-64dc1320ac8e tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "POST /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.070839 Aug 02 09:17:49.320664 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 401/783] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 2 09:17:48 2022] POST /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/os-volume_attachments => generated 194 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:49.843450 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-15806e7f-ca18-4225-8139-871d4daddd86 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.373989 Aug 02 09:17:49.844358 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 383/784] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 2 09:17:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1375 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 09:17:49.860128 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4b107fbb-197e-43cc-a1b8-cb30a35fc119 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:49.860128 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-4b107fbb-197e-43cc-a1b8-cb30a35fc119 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:49.923087 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-4b107fbb-197e-43cc-a1b8-cb30a35fc119 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:49.931240 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-4b107fbb-197e-43cc-a1b8-cb30a35fc119 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1095 microversion: 2.1 time: 0.078831 Aug 02 09:17:49.931935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 402/785] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:49 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1095 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:17:50.957304 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a627c2cd-f48c-4ca2-a6d8-4a5bd5ddafc2 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:50.957964 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-a627c2cd-f48c-4ca2-a6d8-4a5bd5ddafc2 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:50.965433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a627c2cd-f48c-4ca2-a6d8-4a5bd5ddafc2 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:50.965919 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a627c2cd-f48c-4ca2-a6d8-4a5bd5ddafc2 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:50.967858 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a627c2cd-f48c-4ca2-a6d8-4a5bd5ddafc2 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:50.967858 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a627c2cd-f48c-4ca2-a6d8-4a5bd5ddafc2 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:51.032495 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-a627c2cd-f48c-4ca2-a6d8-4a5bd5ddafc2 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:51.040522 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-a627c2cd-f48c-4ca2-a6d8-4a5bd5ddafc2 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1145 microversion: 2.1 time: 0.089224 Aug 02 09:17:51.041091 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 384/786] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:50 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1145 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:52.061896 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-0339eafb-1f3c-4fcd-a79b-984d522dcf54 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:52.062598 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-0339eafb-1f3c-4fcd-a79b-984d522dcf54 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:52.071920 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0339eafb-1f3c-4fcd-a79b-984d522dcf54 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:52.072616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0339eafb-1f3c-4fcd-a79b-984d522dcf54 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:52.073405 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0339eafb-1f3c-4fcd-a79b-984d522dcf54 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:52.073939 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0339eafb-1f3c-4fcd-a79b-984d522dcf54 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:52.186805 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-0339eafb-1f3c-4fcd-a79b-984d522dcf54 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:52.195698 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-0339eafb-1f3c-4fcd-a79b-984d522dcf54 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1193 microversion: 2.1 time: 0.137487 Aug 02 09:17:52.196371 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 403/787] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:52 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1193 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:53.113001 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-1a19dd76-00df-49f4-98e0-6f3e5593b4d5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:53.113568 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-1a19dd76-00df-49f4-98e0-6f3e5593b4d5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:53.120437 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1a19dd76-00df-49f4-98e0-6f3e5593b4d5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:53.120910 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1a19dd76-00df-49f4-98e0-6f3e5593b4d5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:53.121814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1a19dd76-00df-49f4-98e0-6f3e5593b4d5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:53.122304 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1a19dd76-00df-49f4-98e0-6f3e5593b4d5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:53.214475 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.objects.instance [None req-1a19dd76-00df-49f4-98e0-6f3e5593b4d5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lazy-loading 'services' on Instance uuid 4449fe97-0099-41f0-b88e-d7264a4d324c {{(pid=118526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:17:53.220845 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-f5a67ba0-8a2e-4f2c-ac1f-d39b1c71b8bb tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:53.221859 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-f5a67ba0-8a2e-4f2c-ac1f-d39b1c71b8bb tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:53.228876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f5a67ba0-8a2e-4f2c-ac1f-d39b1c71b8bb tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:53.229421 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f5a67ba0-8a2e-4f2c-ac1f-d39b1c71b8bb tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:53.230448 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f5a67ba0-8a2e-4f2c-ac1f-d39b1c71b8bb tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:53.230879 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f5a67ba0-8a2e-4f2c-ac1f-d39b1c71b8bb tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:53.322912 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-f5a67ba0-8a2e-4f2c-ac1f-d39b1c71b8bb tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:53.334720 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-f5a67ba0-8a2e-4f2c-ac1f-d39b1c71b8bb tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1201 microversion: 2.1 time: 0.120633 Aug 02 09:17:53.335712 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 404/788] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:53 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1201 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:53.463958 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-1a19dd76-00df-49f4-98e0-6f3e5593b4d5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments/dcb80b4e-e337-43fa-904b-44096691600e" status: 202 len: 0 microversion: 2.1 time: 0.351576 Aug 02 09:17:53.464660 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 385/789] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 2 09:17:53 2022] DELETE /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments/dcb80b4e-e337-43fa-904b-44096691600e => generated 0 bytes in 356 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 09:17:53.474634 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-2aa855c3-2b34-49a4-b9f2-91de6e17197c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:53.477372 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-2aa855c3-2b34-49a4-b9f2-91de6e17197c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:53.483817 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2aa855c3-2b34-49a4-b9f2-91de6e17197c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:53.484293 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2aa855c3-2b34-49a4-b9f2-91de6e17197c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:53.485061 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2aa855c3-2b34-49a4-b9f2-91de6e17197c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:53.485489 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2aa855c3-2b34-49a4-b9f2-91de6e17197c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:53.518544 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-2aa855c3-2b34-49a4-b9f2-91de6e17197c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048377 Aug 02 09:17:53.519124 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 405/790] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:17:53 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:54.359283 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-0b5cb4c3-bfb6-4880-9c93-02cd36d8a26c tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:54.359985 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-0b5cb4c3-bfb6-4880-9c93-02cd36d8a26c tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:54.367314 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0b5cb4c3-bfb6-4880-9c93-02cd36d8a26c tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:54.367757 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0b5cb4c3-bfb6-4880-9c93-02cd36d8a26c tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:54.368660 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0b5cb4c3-bfb6-4880-9c93-02cd36d8a26c tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:54.369083 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0b5cb4c3-bfb6-4880-9c93-02cd36d8a26c tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:54.450472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-0b5cb4c3-bfb6-4880-9c93-02cd36d8a26c tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:54.458660 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-0b5cb4c3-bfb6-4880-9c93-02cd36d8a26c tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1201 microversion: 2.1 time: 0.104139 Aug 02 09:17:54.459298 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 386/791] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:54 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1201 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:54.532726 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-c5b4af68-99e7-4456-8e54-48971be1cef8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:54.535004 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-c5b4af68-99e7-4456-8e54-48971be1cef8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:54.543900 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c5b4af68-99e7-4456-8e54-48971be1cef8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:54.544390 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c5b4af68-99e7-4456-8e54-48971be1cef8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:54.545399 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c5b4af68-99e7-4456-8e54-48971be1cef8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:54.546162 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c5b4af68-99e7-4456-8e54-48971be1cef8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:54.581227 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-c5b4af68-99e7-4456-8e54-48971be1cef8 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053040 Aug 02 09:17:54.581956 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 406/792] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:17:54 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:55.480258 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-5405f2ac-5b6f-415e-bd39-f430f392cdb5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:55.481240 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-5405f2ac-5b6f-415e-bd39-f430f392cdb5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:55.483863 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:55.489406 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5405f2ac-5b6f-415e-bd39-f430f392cdb5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:55.490603 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5405f2ac-5b6f-415e-bd39-f430f392cdb5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:55.491519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5405f2ac-5b6f-415e-bd39-f430f392cdb5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:55.492193 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5405f2ac-5b6f-415e-bd39-f430f392cdb5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:55.568306 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-5405f2ac-5b6f-415e-bd39-f430f392cdb5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:55.576896 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-5405f2ac-5b6f-415e-bd39-f430f392cdb5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1211 microversion: 2.1 time: 0.100657 Aug 02 09:17:55.577483 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 387/793] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:55 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:55.594503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-33cc2bb7-7d8e-4ee2-8a93-5e6ce18f153c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:55.597098 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-33cc2bb7-7d8e-4ee2-8a93-5e6ce18f153c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:55.604353 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-33cc2bb7-7d8e-4ee2-8a93-5e6ce18f153c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:55.604807 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-33cc2bb7-7d8e-4ee2-8a93-5e6ce18f153c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:55.605662 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-33cc2bb7-7d8e-4ee2-8a93-5e6ce18f153c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:55.606372 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-33cc2bb7-7d8e-4ee2-8a93-5e6ce18f153c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:55.638676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-33cc2bb7-7d8e-4ee2-8a93-5e6ce18f153c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048550 Aug 02 09:17:55.639451 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 407/794] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:17:55 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:17:56.603137 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-86730afd-aa7a-4bbd-9499-abad1149c71a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:56.603836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-86730afd-aa7a-4bbd-9499-abad1149c71a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:56.614206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-86730afd-aa7a-4bbd-9499-abad1149c71a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:56.614206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-86730afd-aa7a-4bbd-9499-abad1149c71a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:56.615121 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-86730afd-aa7a-4bbd-9499-abad1149c71a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:56.615483 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-86730afd-aa7a-4bbd-9499-abad1149c71a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:56.654181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-7b1210fb-c21e-4709-9860-8a52abc73ffc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:56.668754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-7b1210fb-c21e-4709-9860-8a52abc73ffc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:56.670159 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7b1210fb-c21e-4709-9860-8a52abc73ffc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:56.670689 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7b1210fb-c21e-4709-9860-8a52abc73ffc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:56.671490 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7b1210fb-c21e-4709-9860-8a52abc73ffc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:56.671930 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7b1210fb-c21e-4709-9860-8a52abc73ffc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:56.701890 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:56.707974 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-7b1210fb-c21e-4709-9860-8a52abc73ffc tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060285 Aug 02 09:17:56.708669 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 408/795] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:17:56 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:56.866393 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-86730afd-aa7a-4bbd-9499-abad1149c71a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:56.875379 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-86730afd-aa7a-4bbd-9499-abad1149c71a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1279 microversion: 2.1 time: 0.277100 Aug 02 09:17:56.875969 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 388/796] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:56 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1279 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:57.538205 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-a0c8d23f-b09c-4419-b79d-191c6b9dd565 req-ebac58f9-33fc-46be-95f5-ef9cd475272e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c", "tag": "ec5c5fb4-4216-49ff-9a57-3adc12d6b9f9"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:17:57.548749 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-a0c8d23f-b09c-4419-b79d-191c6b9dd565 req-ebac58f9-33fc-46be-95f5-ef9cd475272e service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:57.549186 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-a0c8d23f-b09c-4419-b79d-191c6b9dd565 req-ebac58f9-33fc-46be-95f5-ef9cd475272e service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:57.561133 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-a0c8d23f-b09c-4419-b79d-191c6b9dd565 req-ebac58f9-33fc-46be-95f5-ef9cd475272e service nova] Creating event network-changed:ec5c5fb4-4216-49ff-9a57-3adc12d6b9f9 for instance 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c on hv-cinder-84599 Aug 02 09:17:57.566504 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-a0c8d23f-b09c-4419-b79d-191c6b9dd565 req-ebac58f9-33fc-46be-95f5-ef9cd475272e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033480 Aug 02 09:17:57.567809 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 409/797] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:57.720935 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-28800fee-9f04-47fa-957e-d945409c1ca0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:57.723275 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-28800fee-9f04-47fa-957e-d945409c1ca0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:57.731274 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-28800fee-9f04-47fa-957e-d945409c1ca0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:57.731722 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-28800fee-9f04-47fa-957e-d945409c1ca0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:57.732573 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-28800fee-9f04-47fa-957e-d945409c1ca0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:57.733006 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-28800fee-9f04-47fa-957e-d945409c1ca0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:57.767039 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-28800fee-9f04-47fa-957e-d945409c1ca0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050329 Aug 02 09:17:57.767876 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 389/798] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:17:57 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:57.899888 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-beefd463-de34-4458-b845-f80ce0fd5733 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:57.900614 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-beefd463-de34-4458-b845-f80ce0fd5733 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:57.907144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-beefd463-de34-4458-b845-f80ce0fd5733 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:57.907597 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-beefd463-de34-4458-b845-f80ce0fd5733 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:57.908409 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-beefd463-de34-4458-b845-f80ce0fd5733 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:57.908849 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-beefd463-de34-4458-b845-f80ce0fd5733 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:58.147644 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-beefd463-de34-4458-b845-f80ce0fd5733 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:58.155379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-beefd463-de34-4458-b845-f80ce0fd5733 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1279 microversion: 2.1 time: 0.260847 Aug 02 09:17:58.156760 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 410/799] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:57 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1279 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:58.779682 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-6f7dadeb-2656-4830-91f6-8aafd0fdba9a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:58.781874 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-6f7dadeb-2656-4830-91f6-8aafd0fdba9a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:58.789121 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6f7dadeb-2656-4830-91f6-8aafd0fdba9a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:58.789666 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6f7dadeb-2656-4830-91f6-8aafd0fdba9a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:58.790426 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6f7dadeb-2656-4830-91f6-8aafd0fdba9a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:58.790869 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6f7dadeb-2656-4830-91f6-8aafd0fdba9a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:58.820471 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-6f7dadeb-2656-4830-91f6-8aafd0fdba9a tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044638 Aug 02 09:17:58.821039 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 390/800] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:17:58 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:17:59.177938 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-65e2cbf4-669b-430c-90f9-55d5ebdec57b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:59.179505 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-65e2cbf4-669b-430c-90f9-55d5ebdec57b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:59.185376 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-65e2cbf4-669b-430c-90f9-55d5ebdec57b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:59.185851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-65e2cbf4-669b-430c-90f9-55d5ebdec57b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:59.186617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-65e2cbf4-669b-430c-90f9-55d5ebdec57b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:59.187053 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-65e2cbf4-669b-430c-90f9-55d5ebdec57b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:59.339930 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-65e2cbf4-669b-430c-90f9-55d5ebdec57b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:17:59.347465 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-65e2cbf4-669b-430c-90f9-55d5ebdec57b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1279 microversion: 2.1 time: 0.174339 Aug 02 09:17:59.348035 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 411/801] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:17:59 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1279 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:17:59.833106 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-d7e5de94-eefe-4c85-9b9a-ceb27981b349 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:17:59.835990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-d7e5de94-eefe-4c85-9b9a-ceb27981b349 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:17:59.837892 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=2 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:59.838564 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=6 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:17:59.844045 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d7e5de94-eefe-4c85-9b9a-ceb27981b349 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:59.850800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d7e5de94-eefe-4c85-9b9a-ceb27981b349 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:59.850800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d7e5de94-eefe-4c85-9b9a-ceb27981b349 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:17:59.850800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d7e5de94-eefe-4c85-9b9a-ceb27981b349 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:17:59.882005 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-d7e5de94-eefe-4c85-9b9a-ceb27981b349 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052837 Aug 02 09:17:59.882573 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 391/802] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:17:59 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:00.371558 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-1e3b5d79-cd6c-45e2-ae14-a75e2f5d2f55 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:00.372246 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-1e3b5d79-cd6c-45e2-ae14-a75e2f5d2f55 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:00.374235 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=2 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:00.379978 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1e3b5d79-cd6c-45e2-ae14-a75e2f5d2f55 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:00.380460 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1e3b5d79-cd6c-45e2-ae14-a75e2f5d2f55 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:00.382020 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1e3b5d79-cd6c-45e2-ae14-a75e2f5d2f55 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:00.382464 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1e3b5d79-cd6c-45e2-ae14-a75e2f5d2f55 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:00.546358 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-1e3b5d79-cd6c-45e2-ae14-a75e2f5d2f55 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:00.561664 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-1e3b5d79-cd6c-45e2-ae14-a75e2f5d2f55 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1279 microversion: 2.1 time: 0.193803 Aug 02 09:18:00.562749 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 412/803] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:00 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1279 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:00.898009 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-4da25efc-14a0-4d05-a1ec-8209f4ee04c0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:00.901702 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-4da25efc-14a0-4d05-a1ec-8209f4ee04c0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:00.910086 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4da25efc-14a0-4d05-a1ec-8209f4ee04c0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:00.910544 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4da25efc-14a0-4d05-a1ec-8209f4ee04c0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:00.911391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4da25efc-14a0-4d05-a1ec-8209f4ee04c0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:00.911779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4da25efc-14a0-4d05-a1ec-8209f4ee04c0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:00.947826 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-4da25efc-14a0-4d05-a1ec-8209f4ee04c0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056887 Aug 02 09:18:00.948672 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 392/804] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:18:00 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:01.272715 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-3ea62bdd-b508-4067-873e-20d7792d193d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:01.275353 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-3ea62bdd-b508-4067-873e-20d7792d193d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:01.282255 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3ea62bdd-b508-4067-873e-20d7792d193d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:01.283002 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3ea62bdd-b508-4067-873e-20d7792d193d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:01.283962 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3ea62bdd-b508-4067-873e-20d7792d193d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:01.284598 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3ea62bdd-b508-4067-873e-20d7792d193d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:01.315717 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-3ea62bdd-b508-4067-873e-20d7792d193d tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047006 Aug 02 09:18:01.316256 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 413/805] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Aug 2 09:18:01 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:01.382026 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a28512ea-9aa3-4c52-a649-21cb737ff07a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:01.383049 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-a28512ea-9aa3-4c52-a649-21cb737ff07a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:01.389343 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a28512ea-9aa3-4c52-a649-21cb737ff07a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:01.389834 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a28512ea-9aa3-4c52-a649-21cb737ff07a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:01.390788 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a28512ea-9aa3-4c52-a649-21cb737ff07a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:01.391223 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a28512ea-9aa3-4c52-a649-21cb737ff07a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:01.421336 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-a28512ea-9aa3-4c52-a649-21cb737ff07a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Going to try to terminate instance {{(pid=118526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:18:01.588348 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-c308e81e-393f-4ba7-a4bd-c940440fede9 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:01.588995 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-c308e81e-393f-4ba7-a4bd-c940440fede9 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:01.596266 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c308e81e-393f-4ba7-a4bd-c940440fede9 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:01.596713 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c308e81e-393f-4ba7-a4bd-c940440fede9 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:01.597490 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c308e81e-393f-4ba7-a4bd-c940440fede9 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:01.597920 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c308e81e-393f-4ba7-a4bd-c940440fede9 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:01.751476 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-c308e81e-393f-4ba7-a4bd-c940440fede9 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:01.760414 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-c308e81e-393f-4ba7-a4bd-c940440fede9 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1279 microversion: 2.1 time: 0.176569 Aug 02 09:18:01.761032 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 414/806] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:01 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1279 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:01.822291 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-a28512ea-9aa3-4c52-a649-21cb737ff07a tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 204 len: 0 microversion: 2.20 time: 0.443552 Aug 02 09:18:01.822948 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 393/807] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Aug 2 09:18:01 2022] DELETE /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 09:18:01.832472 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-5590ba66-f575-488c-ac6f-b0749b79a4a0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:01.833254 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-5590ba66-f575-488c-ac6f-b0749b79a4a0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:01.841564 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5590ba66-f575-488c-ac6f-b0749b79a4a0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:01.842071 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5590ba66-f575-488c-ac6f-b0749b79a4a0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:01.842928 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5590ba66-f575-488c-ac6f-b0749b79a4a0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:01.843452 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5590ba66-f575-488c-ac6f-b0749b79a4a0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:01.968439 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a6e1ee12-fbe9-4f5f-b825-3ce261fdf073 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:01.976109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-a6e1ee12-fbe9-4f5f-b825-3ce261fdf073 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:01.993827 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-5590ba66-f575-488c-ac6f-b0749b79a4a0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:01.995502 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a6e1ee12-fbe9-4f5f-b825-3ce261fdf073 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:01.996039 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a6e1ee12-fbe9-4f5f-b825-3ce261fdf073 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:01.996845 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a6e1ee12-fbe9-4f5f-b825-3ce261fdf073 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:01.997291 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a6e1ee12-fbe9-4f5f-b825-3ce261fdf073 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:02.003304 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-5590ba66-f575-488c-ac6f-b0749b79a4a0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:02.004946 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-5590ba66-f575-488c-ac6f-b0749b79a4a0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:02.006144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-5590ba66-f575-488c-ac6f-b0749b79a4a0 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1722 microversion: 2.20 time: 0.178483 Aug 02 09:18:02.006912 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 415/808] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:18:01 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:18:02.036314 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-a6e1ee12-fbe9-4f5f-b825-3ce261fdf073 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077890 Aug 02 09:18:02.038537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 394/809] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:18:01 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:02.787277 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-bbf5252a-f5f7-4702-8b47-f65bbc1ba66a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:02.789667 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-bbf5252a-f5f7-4702-8b47-f65bbc1ba66a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:02.797058 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bbf5252a-f5f7-4702-8b47-f65bbc1ba66a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:02.797499 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bbf5252a-f5f7-4702-8b47-f65bbc1ba66a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:02.798278 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bbf5252a-f5f7-4702-8b47-f65bbc1ba66a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:02.798712 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bbf5252a-f5f7-4702-8b47-f65bbc1ba66a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:02.960300 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-bbf5252a-f5f7-4702-8b47-f65bbc1ba66a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:02.969192 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-bbf5252a-f5f7-4702-8b47-f65bbc1ba66a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1279 microversion: 2.1 time: 0.187894 Aug 02 09:18:02.970321 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 416/810] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:02 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1279 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:03.035838 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-f8486012-7089-4be5-b26c-19f3420c9903 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:03.037382 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-f8486012-7089-4be5-b26c-19f3420c9903 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:03.049979 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-77caad6b-0c13-46f7-904b-bb7207463834 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:03.053970 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f8486012-7089-4be5-b26c-19f3420c9903 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:03.053970 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f8486012-7089-4be5-b26c-19f3420c9903 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:03.053970 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f8486012-7089-4be5-b26c-19f3420c9903 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:03.054324 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-77caad6b-0c13-46f7-904b-bb7207463834 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:03.054410 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f8486012-7089-4be5-b26c-19f3420c9903 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:03.060805 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-77caad6b-0c13-46f7-904b-bb7207463834 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:03.061662 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-77caad6b-0c13-46f7-904b-bb7207463834 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:03.062792 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-77caad6b-0c13-46f7-904b-bb7207463834 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:03.063468 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-77caad6b-0c13-46f7-904b-bb7207463834 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:03.104943 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-77caad6b-0c13-46f7-904b-bb7207463834 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058348 Aug 02 09:18:03.105556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 417/811] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:18:03 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:03.246276 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-f8486012-7089-4be5-b26c-19f3420c9903 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:03.254784 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-f8486012-7089-4be5-b26c-19f3420c9903 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:03.256324 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-f8486012-7089-4be5-b26c-19f3420c9903 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:03.258181 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-f8486012-7089-4be5-b26c-19f3420c9903 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1722 microversion: 2.20 time: 0.228692 Aug 02 09:18:03.258702 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 395/812] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:18:03 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:18:03.991556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-efb7f043-9495-418f-902f-8e5ea2c458c1 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:03.993501 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-efb7f043-9495-418f-902f-8e5ea2c458c1 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:04.000526 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-efb7f043-9495-418f-902f-8e5ea2c458c1 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:04.000970 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-efb7f043-9495-418f-902f-8e5ea2c458c1 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:04.001745 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-efb7f043-9495-418f-902f-8e5ea2c458c1 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:04.002178 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-efb7f043-9495-418f-902f-8e5ea2c458c1 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:04.120030 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-83f501fe-2a64-4426-88dc-c226085d16ed tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:04.122411 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-83f501fe-2a64-4426-88dc-c226085d16ed tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:04.129791 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-83f501fe-2a64-4426-88dc-c226085d16ed tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:04.130246 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-83f501fe-2a64-4426-88dc-c226085d16ed tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:04.131033 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-83f501fe-2a64-4426-88dc-c226085d16ed tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:04.131505 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-83f501fe-2a64-4426-88dc-c226085d16ed tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:04.150317 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:04.153341 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-efb7f043-9495-418f-902f-8e5ea2c458c1 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:04.161151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-efb7f043-9495-418f-902f-8e5ea2c458c1 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1279 microversion: 2.1 time: 0.173966 Aug 02 09:18:04.161745 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 418/813] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:03 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1279 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:04.165116 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-83f501fe-2a64-4426-88dc-c226085d16ed tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049784 Aug 02 09:18:04.165694 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 396/814] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:18:04 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:04.284184 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-fd1ff3b9-291a-4db3-b60b-1e7ee2653547 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:04.284996 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-fd1ff3b9-291a-4db3-b60b-1e7ee2653547 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:04.295629 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fd1ff3b9-291a-4db3-b60b-1e7ee2653547 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:04.296084 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fd1ff3b9-291a-4db3-b60b-1e7ee2653547 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:04.296914 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fd1ff3b9-291a-4db3-b60b-1e7ee2653547 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:04.297390 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fd1ff3b9-291a-4db3-b60b-1e7ee2653547 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:04.573650 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-fd1ff3b9-291a-4db3-b60b-1e7ee2653547 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:04.582718 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-fd1ff3b9-291a-4db3-b60b-1e7ee2653547 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:04.584322 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-fd1ff3b9-291a-4db3-b60b-1e7ee2653547 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:04.586132 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-fd1ff3b9-291a-4db3-b60b-1e7ee2653547 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1722 microversion: 2.20 time: 0.307359 Aug 02 09:18:04.586693 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 419/815] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:18:04 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:18:04.924139 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-6694c87b-7ff1-42df-b3b5-33c0b13bd6db tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:04.926580 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-6694c87b-7ff1-42df-b3b5-33c0b13bd6db tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:04.935073 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6694c87b-7ff1-42df-b3b5-33c0b13bd6db tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:04.937231 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6694c87b-7ff1-42df-b3b5-33c0b13bd6db tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:04.937231 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6694c87b-7ff1-42df-b3b5-33c0b13bd6db tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:04.937231 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6694c87b-7ff1-42df-b3b5-33c0b13bd6db tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.000127 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-6694c87b-7ff1-42df-b3b5-33c0b13bd6db tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.079568 Aug 02 09:18:05.004286 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 397/816] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:18:04 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/os-volume_attachments => generated 371 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:05.159871 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-658fc1ba-d351-4a50-8b76-971c147e9efb tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:05.160438 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-658fc1ba-d351-4a50-8b76-971c147e9efb tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:05.169157 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-658fc1ba-d351-4a50-8b76-971c147e9efb tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.169606 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-658fc1ba-d351-4a50-8b76-971c147e9efb tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.170459 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-658fc1ba-d351-4a50-8b76-971c147e9efb tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.170849 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-658fc1ba-d351-4a50-8b76-971c147e9efb tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.189119 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-e322c1a1-6843-4616-b9c6-835b33765c96 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:05.189781 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-e322c1a1-6843-4616-b9c6-835b33765c96 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:05.202116 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e322c1a1-6843-4616-b9c6-835b33765c96 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.202463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e322c1a1-6843-4616-b9c6-835b33765c96 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.203044 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e322c1a1-6843-4616-b9c6-835b33765c96 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.203481 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e322c1a1-6843-4616-b9c6-835b33765c96 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.205532 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-658fc1ba-d351-4a50-8b76-971c147e9efb tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/os-volume_attachments/1eee8e56-6c58-4064-87ea-e4422eaf1e99" status: 200 len: 194 microversion: 2.1 time: 0.050760 Aug 02 09:18:05.206153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 420/817] 10.222.0.20 () {58 vars in 1413 bytes} [Tue Aug 2 09:18:05 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/os-volume_attachments/1eee8e56-6c58-4064-87ea-e4422eaf1e99 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:05.213558 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-290ddff5-8356-4395-8416-da70f2555015 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:05.217167 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-290ddff5-8356-4395-8416-da70f2555015 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:05.224427 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-290ddff5-8356-4395-8416-da70f2555015 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.225180 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-290ddff5-8356-4395-8416-da70f2555015 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.226542 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-290ddff5-8356-4395-8416-da70f2555015 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.227200 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-290ddff5-8356-4395-8416-da70f2555015 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.262775 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-290ddff5-8356-4395-8416-da70f2555015 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053944 Aug 02 09:18:05.263539 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 421/818] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:18:05 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:18:05.268315 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-91bfe3ec-b536-483a-b9de-12504519b68c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:05.268936 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-91bfe3ec-b536-483a-b9de-12504519b68c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:05.275867 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-91bfe3ec-b536-483a-b9de-12504519b68c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.276362 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-91bfe3ec-b536-483a-b9de-12504519b68c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.277498 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-91bfe3ec-b536-483a-b9de-12504519b68c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.277638 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-91bfe3ec-b536-483a-b9de-12504519b68c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.439290 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-e322c1a1-6843-4616-b9c6-835b33765c96 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:05.441926 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.objects.instance [None req-91bfe3ec-b536-483a-b9de-12504519b68c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lazy-loading 'services' on Instance uuid 71fb0604-8809-49fd-9b86-e8441c47c2be {{(pid=118525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:18:05.450719 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-e322c1a1-6843-4616-b9c6-835b33765c96 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1279 microversion: 2.1 time: 0.270526 Aug 02 09:18:05.452075 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 398/819] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:05 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1279 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:05.468909 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-aa717624-0b9d-48d8-976c-7a96502189e5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:05.469731 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-aa717624-0b9d-48d8-976c-7a96502189e5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:05.477809 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-aa717624-0b9d-48d8-976c-7a96502189e5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.478329 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-aa717624-0b9d-48d8-976c-7a96502189e5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.482010 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-aa717624-0b9d-48d8-976c-7a96502189e5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.482010 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-aa717624-0b9d-48d8-976c-7a96502189e5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.515363 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-aa717624-0b9d-48d8-976c-7a96502189e5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Going to try to terminate instance {{(pid=118526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:18:05.707096 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-91bfe3ec-b536-483a-b9de-12504519b68c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "DELETE /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/os-volume_attachments/1eee8e56-6c58-4064-87ea-e4422eaf1e99" status: 202 len: 0 microversion: 2.1 time: 0.442430 Aug 02 09:18:05.707812 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 422/820] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 2 09:18:05 2022] DELETE /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/os-volume_attachments/1eee8e56-6c58-4064-87ea-e4422eaf1e99 => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:18:05.727715 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-a5a0f4cf-344b-4fe2-9f2d-703cef91d01e req-b7cc5cbf-129d-4642-aaba-45c17f1816a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b54fded6-ca19-48e6-b971-31f061cce0c5", "name": "network-vif-deleted", "tag": "021d8483-0afc-44b7-b117-6f61fcf5696d"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:05.743034 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-a5a0f4cf-344b-4fe2-9f2d-703cef91d01e req-b7cc5cbf-129d-4642-aaba-45c17f1816a3 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.744013 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-a5a0f4cf-344b-4fe2-9f2d-703cef91d01e req-b7cc5cbf-129d-4642-aaba-45c17f1816a3 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.757521 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-a5a0f4cf-344b-4fe2-9f2d-703cef91d01e req-b7cc5cbf-129d-4642-aaba-45c17f1816a3 service nova] Creating event network-vif-deleted:021d8483-0afc-44b7-b117-6f61fcf5696d for instance b54fded6-ca19-48e6-b971-31f061cce0c5 on hv-cinder-84599 Aug 02 09:18:05.764129 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-a5a0f4cf-344b-4fe2-9f2d-703cef91d01e req-b7cc5cbf-129d-4642-aaba-45c17f1816a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054312 Aug 02 09:18:05.765193 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 423/821] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:05.770913 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-5fe09bd9-9aa3-4599-828b-4ab014f220df tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:05.771629 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-5fe09bd9-9aa3-4599-828b-4ab014f220df tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:05.779324 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5fe09bd9-9aa3-4599-828b-4ab014f220df tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.780054 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5fe09bd9-9aa3-4599-828b-4ab014f220df tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.780877 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5fe09bd9-9aa3-4599-828b-4ab014f220df tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.781496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5fe09bd9-9aa3-4599-828b-4ab014f220df tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.831200 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5fe09bd9-9aa3-4599-828b-4ab014f220df tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:05.832369 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5fe09bd9-9aa3-4599-828b-4ab014f220df tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:05.832983 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.objects.instance [None req-5fe09bd9-9aa3-4599-828b-4ab014f220df tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lazy-loading 'fault' on Instance uuid b54fded6-ca19-48e6-b971-31f061cce0c5 {{(pid=118525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:18:05.917341 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-5fe09bd9-9aa3-4599-828b-4ab014f220df tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:05.927111 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-5fe09bd9-9aa3-4599-828b-4ab014f220df tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:05.928885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-5fe09bd9-9aa3-4599-828b-4ab014f220df tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:05.930709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-5fe09bd9-9aa3-4599-828b-4ab014f220df tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1371 microversion: 2.20 time: 0.164741 Aug 02 09:18:05.931263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 424/822] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:18:05 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:18:05.992467 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-aa717624-0b9d-48d8-976c-7a96502189e5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c" status: 204 len: 0 microversion: 2.1 time: 0.538185 Aug 02 09:18:05.994435 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 399/823] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:18:05 2022] DELETE /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c => generated 0 bytes in 541 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:18:06.002588 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-6cbe933a-f97b-4dc4-8487-e29deacc83d5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:06.003454 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-6cbe933a-f97b-4dc4-8487-e29deacc83d5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:06.012241 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6cbe933a-f97b-4dc4-8487-e29deacc83d5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:06.012698 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6cbe933a-f97b-4dc4-8487-e29deacc83d5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:06.013496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6cbe933a-f97b-4dc4-8487-e29deacc83d5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:06.014127 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6cbe933a-f97b-4dc4-8487-e29deacc83d5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:06.019488 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:06.172828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-6cbe933a-f97b-4dc4-8487-e29deacc83d5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:06.181761 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-6cbe933a-f97b-4dc4-8487-e29deacc83d5 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c" status: 200 len: 1680 microversion: 2.1 time: 0.183066 Aug 02 09:18:06.182403 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 425/824] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:05 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:06.474469 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-55205465-ca23-4c24-a387-c2e6280fc237 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:06.475236 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-55205465-ca23-4c24-a387-c2e6280fc237 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:06.482731 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-55205465-ca23-4c24-a387-c2e6280fc237 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:06.483193 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-55205465-ca23-4c24-a387-c2e6280fc237 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:06.483968 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-55205465-ca23-4c24-a387-c2e6280fc237 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:06.484443 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-55205465-ca23-4c24-a387-c2e6280fc237 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:06.629464 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-55205465-ca23-4c24-a387-c2e6280fc237 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:06.638544 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-55205465-ca23-4c24-a387-c2e6280fc237 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1279 microversion: 2.1 time: 0.168498 Aug 02 09:18:06.639136 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 400/825] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:06 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1279 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:06.955717 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-df8668aa-81f5-45c6-a027-4065443f634c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:06.956389 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-df8668aa-81f5-45c6-a027-4065443f634c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:06.963643 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-df8668aa-81f5-45c6-a027-4065443f634c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:06.964151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-df8668aa-81f5-45c6-a027-4065443f634c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:06.965034 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-df8668aa-81f5-45c6-a027-4065443f634c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:06.965465 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-df8668aa-81f5-45c6-a027-4065443f634c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:06.997153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-df8668aa-81f5-45c6-a027-4065443f634c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:06.997591 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-df8668aa-81f5-45c6-a027-4065443f634c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:06.998034 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.objects.instance [None req-df8668aa-81f5-45c6-a027-4065443f634c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lazy-loading 'fault' on Instance uuid b54fded6-ca19-48e6-b971-31f061cce0c5 {{(pid=118525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:18:07.044657 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-df8668aa-81f5-45c6-a027-4065443f634c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:07.052735 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-df8668aa-81f5-45c6-a027-4065443f634c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:07.054480 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-df8668aa-81f5-45c6-a027-4065443f634c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '4a1a40ef55434cd48a2dc4385880fe0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06061d6914ac4b86841d45162ceeb89f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:07.055662 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-df8668aa-81f5-45c6-a027-4065443f634c tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 200 len: 1371 microversion: 2.20 time: 0.103954 Aug 02 09:18:07.056252 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 426/826] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:18:06 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 02 09:18:07.203930 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-06de0f11-98af-44c2-8669-a947685653c3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:07.204571 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-06de0f11-98af-44c2-8669-a947685653c3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:07.211370 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-06de0f11-98af-44c2-8669-a947685653c3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:07.211872 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-06de0f11-98af-44c2-8669-a947685653c3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:07.212682 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-06de0f11-98af-44c2-8669-a947685653c3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:07.213165 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-06de0f11-98af-44c2-8669-a947685653c3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:07.364309 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-06de0f11-98af-44c2-8669-a947685653c3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:07.372361 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-06de0f11-98af-44c2-8669-a947685653c3 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c" status: 200 len: 1680 microversion: 2.1 time: 0.172339 Aug 02 09:18:07.373001 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 401/827] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:07 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:07.665043 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-9c5bd308-8236-4dca-85e8-f6fc9bbe7f6d tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:07.665860 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-9c5bd308-8236-4dca-85e8-f6fc9bbe7f6d tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:07.672813 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9c5bd308-8236-4dca-85e8-f6fc9bbe7f6d tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:07.673361 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9c5bd308-8236-4dca-85e8-f6fc9bbe7f6d tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:07.674158 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9c5bd308-8236-4dca-85e8-f6fc9bbe7f6d tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:07.674599 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9c5bd308-8236-4dca-85e8-f6fc9bbe7f6d tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:08.080431 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b14b60df-99e6-43b0-8b19-250963c5a9b6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:08.081062 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b14b60df-99e6-43b0-8b19-250963c5a9b6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:08.090359 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b14b60df-99e6-43b0-8b19-250963c5a9b6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:08.091083 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b14b60df-99e6-43b0-8b19-250963c5a9b6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:08.093133 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b14b60df-99e6-43b0-8b19-250963c5a9b6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:08.106495 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b14b60df-99e6-43b0-8b19-250963c5a9b6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:08.131358 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-b14b60df-99e6-43b0-8b19-250963c5a9b6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] HTTP exception thrown: Instance b54fded6-ca19-48e6-b971-31f061cce0c5 could not be found. Aug 02 09:18:08.133844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b14b60df-99e6-43b0-8b19-250963c5a9b6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Request method failure captured: Aug 02 09:18:08.133844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 HTTP/1.1 Aug 02 09:18:08.133844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:18:08.133844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:18:08.133844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:18:08.133844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:18:08.133844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:18:08.133844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:18:08.133844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:18:08.133844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:08.133844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OoRT2KmPOrbFwi17IerArjCVuPRvNuR_ftdfux-dglsWpzjnybStZVi73M6KoPiMnSPwswC3oPIk2nAftEkrc45NeUE0vfe39o3Ba-J-4bw7BGpvYXczGIMGnYpIRDEnnQ1Hg0tHLBummYQaRlFeZPdww-C2_01n4KUnUWFlWfKaVY Aug 02 09:18:08.133844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:18:08.133844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:18:08.133844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:18:08.133844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:18:08.133844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 09:18:08.133844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:18:08.133844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:18:08.133844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: 06061d6914ac4b86841d45162ceeb89f Aug 02 09:18:08.133844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1976077308 Aug 02 09:18:08.133844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:18:08.133844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:18:08.135678 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/06061d6914ac4b86841d45162ceeb89f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/06061d6914ac4b86841d45162ceeb89f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/06061d6914ac4b86841d45162ceeb89f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_06061d6914ac4b86841d45162ceeb89f"}]}] Aug 02 09:18:08.135678 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1976077308 Aug 02 09:18:08.135678 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: 06061d6914ac4b86841d45162ceeb89f Aug 02 09:18:08.135678 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1976077308 Aug 02 09:18:08.135678 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-AttachVolumeShelveTestJSON-1976077308-project Aug 02 09:18:08.135678 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:18:08.135678 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:18:08.135678 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: 4a1a40ef55434cd48a2dc4385880fe0b Aug 02 09:18:08.135678 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1976077308-project Aug 02 09:18:08.135678 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:18:08.135678 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Instance b54fded6-ca19-48e6-b971-31f061cce0c5 could not be found. Aug 02 09:18:08.135678 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'id': 'b54fded6-ca19-48e6-b971-31f061cce0c5'} Aug 02 09:18:08.136474 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:08.136474 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:08.136474 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:08.136474 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:08.136474 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:08.136474 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:08.136474 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:08.136474 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:08.136474 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:08.136474 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:08.136474 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b54fded6-ca19-48e6-b971-31f061cce0c5 could not be found. Aug 02 09:18:08.136474 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:08.136474 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:08.136474 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:08.136474 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:08.136474 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:08.136474 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:08.136474 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:08.136474 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:08.136474 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:08.138006 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:08.138006 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:18:08.138006 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:18:08.138006 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:08.138006 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:08.138006 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:08.138006 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:08.138006 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b54fded6-ca19-48e6-b971-31f061cce0c5 could not be found. Aug 02 09:18:08.138006 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:08.138006 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:08.138006 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:08.138006 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:08.138006 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:08.138006 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:08.138006 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:08.138006 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:08.138006 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b54fded6-ca19-48e6-b971-31f061cce0c5 could not be found. Aug 02 09:18:08.138006 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:08.139294 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-9c5bd308-8236-4dca-85e8-f6fc9bbe7f6d tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:08.140933 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b14b60df-99e6-43b0-8b19-250963c5a9b6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Returning 404 to user: Instance b54fded6-ca19-48e6-b971-31f061cce0c5 could not be found. {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:08.142059 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b14b60df-99e6-43b0-8b19-250963c5a9b6 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 404 len: 111 microversion: 2.20 time: 0.066925 Aug 02 09:18:08.143156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 402/828] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:18:08 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:18:08.153029 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-0610c887-c7c2-4f29-8307-cfdc76ba2b2e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '.version_select at 0x7ffb9a9d78b0>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:08.157182 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-9c5bd308-8236-4dca-85e8-f6fc9bbe7f6d tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1279 microversion: 2.1 time: 0.491885 Aug 02 09:18:08.157884 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 427/829] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:07 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1279 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:08.262010 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-0610c887-c7c2-4f29-8307-cfdc76ba2b2e tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-959951953" status: 204 len: 0 microversion: 2.20 time: 0.114132 Aug 02 09:18:08.262776 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 403/830] 10.222.0.20 () {60 vars in 1259 bytes} [Tue Aug 2 09:18:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-959951953 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 02 09:18:08.397342 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-5c7bef16-4ea9-4d0f-88b6-f5bd47719ab6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:08.397993 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-5c7bef16-4ea9-4d0f-88b6-f5bd47719ab6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:08.399923 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=72 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:08.405302 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5c7bef16-4ea9-4d0f-88b6-f5bd47719ab6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:08.405684 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5c7bef16-4ea9-4d0f-88b6-f5bd47719ab6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:08.406474 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5c7bef16-4ea9-4d0f-88b6-f5bd47719ab6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:08.407361 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5c7bef16-4ea9-4d0f-88b6-f5bd47719ab6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:09.035668 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-5c7bef16-4ea9-4d0f-88b6-f5bd47719ab6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:09.076835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-5c7bef16-4ea9-4d0f-88b6-f5bd47719ab6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c" status: 200 len: 1680 microversion: 2.1 time: 0.683481 Aug 02 09:18:09.078399 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 428/831] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:08 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c => generated 1680 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:09.191031 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-80711fbe-a23a-4ede-8c44-f516fd93e1ca tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:09.192073 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-80711fbe-a23a-4ede-8c44-f516fd93e1ca tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:09.202927 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-80711fbe-a23a-4ede-8c44-f516fd93e1ca tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:09.203487 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-80711fbe-a23a-4ede-8c44-f516fd93e1ca tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:09.205234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-80711fbe-a23a-4ede-8c44-f516fd93e1ca tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:09.206202 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-80711fbe-a23a-4ede-8c44-f516fd93e1ca tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:09.345006 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-16321275-f14f-4603-9f35-f3a14f396f0d req-f33deb4a-35b4-4ee7-868a-06fc4eb6e1f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4449fe97-0099-41f0-b88e-d7264a4d324c", "name": "network-vif-deleted", "tag": "6093acc7-df9f-48e9-afda-92e299aa6bad"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:09.361684 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-16321275-f14f-4603-9f35-f3a14f396f0d req-f33deb4a-35b4-4ee7-868a-06fc4eb6e1f3 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:09.362379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-16321275-f14f-4603-9f35-f3a14f396f0d req-f33deb4a-35b4-4ee7-868a-06fc4eb6e1f3 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:09.392830 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-16321275-f14f-4603-9f35-f3a14f396f0d req-f33deb4a-35b4-4ee7-868a-06fc4eb6e1f3 service nova] Creating event network-vif-deleted:6093acc7-df9f-48e9-afda-92e299aa6bad for instance 4449fe97-0099-41f0-b88e-d7264a4d324c on hv-cinder-84599 Aug 02 09:18:09.400500 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-16321275-f14f-4603-9f35-f3a14f396f0d req-f33deb4a-35b4-4ee7-868a-06fc4eb6e1f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060936 Aug 02 09:18:09.402771 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 429/832] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:09.475415 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-80711fbe-a23a-4ede-8c44-f516fd93e1ca tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:09.486136 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-80711fbe-a23a-4ede-8c44-f516fd93e1ca tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1267 microversion: 2.1 time: 0.308201 Aug 02 09:18:09.487881 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 404/833] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:09 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1267 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:10.078659 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-bc05931b-bd51-4f48-8898-6b15685ef7a7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:10.079328 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-bc05931b-bd51-4f48-8898-6b15685ef7a7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:10.087681 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bc05931b-bd51-4f48-8898-6b15685ef7a7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:10.088127 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bc05931b-bd51-4f48-8898-6b15685ef7a7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:10.089236 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bc05931b-bd51-4f48-8898-6b15685ef7a7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:10.089695 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bc05931b-bd51-4f48-8898-6b15685ef7a7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:10.106973 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c9042304-68fb-4ab5-910d-7d32c826d11c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:10.108114 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-c9042304-68fb-4ab5-910d-7d32c826d11c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:10.118806 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c9042304-68fb-4ab5-910d-7d32c826d11c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:10.120035 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c9042304-68fb-4ab5-910d-7d32c826d11c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:10.121500 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c9042304-68fb-4ab5-910d-7d32c826d11c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:10.122240 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c9042304-68fb-4ab5-910d-7d32c826d11c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:10.142237 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-bc05931b-bd51-4f48-8898-6b15685ef7a7 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/os-volume_attachments/ce3c1342-9c8a-4c9e-bd48-7ab0458ea8bb" status: 200 len: 194 microversion: 2.1 time: 0.067931 Aug 02 09:18:10.142914 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 430/834] 10.222.0.20 () {58 vars in 1413 bytes} [Tue Aug 2 09:18:10 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/os-volume_attachments/ce3c1342-9c8a-4c9e-bd48-7ab0458ea8bb => generated 194 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:10.166019 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-53620d76-e6d8-4779-813a-4b064a394b9a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:10.167124 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-53620d76-e6d8-4779-813a-4b064a394b9a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:10.179852 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c9042304-68fb-4ab5-910d-7d32c826d11c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:10.180612 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-53620d76-e6d8-4779-813a-4b064a394b9a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:10.181598 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-53620d76-e6d8-4779-813a-4b064a394b9a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:10.182110 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c9042304-68fb-4ab5-910d-7d32c826d11c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:10.182612 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.objects.instance [None req-c9042304-68fb-4ab5-910d-7d32c826d11c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lazy-loading 'fault' on Instance uuid 4449fe97-0099-41f0-b88e-d7264a4d324c {{(pid=118526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:18:10.183046 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-53620d76-e6d8-4779-813a-4b064a394b9a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:10.183944 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-53620d76-e6d8-4779-813a-4b064a394b9a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:10.256049 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-c9042304-68fb-4ab5-910d-7d32c826d11c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ad3a9141e9284bb5a096fb04d3e9d581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6fc6b07497a48eeb263b3a9b8aa7499', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:10.274520 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-c9042304-68fb-4ab5-910d-7d32c826d11c tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c" status: 200 len: 1330 microversion: 2.1 time: 0.174093 Aug 02 09:18:10.286768 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 405/835] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:10 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c => generated 1330 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:10.316003 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.objects.instance [None req-53620d76-e6d8-4779-813a-4b064a394b9a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lazy-loading 'services' on Instance uuid 71fb0604-8809-49fd-9b86-e8441c47c2be {{(pid=118525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:18:10.511440 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-02b08959-f6a1-4435-bc0c-5cc8bf0c7d47 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:10.512050 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-02b08959-f6a1-4435-bc0c-5cc8bf0c7d47 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:10.519771 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-02b08959-f6a1-4435-bc0c-5cc8bf0c7d47 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:10.520644 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-02b08959-f6a1-4435-bc0c-5cc8bf0c7d47 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:10.521795 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-02b08959-f6a1-4435-bc0c-5cc8bf0c7d47 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:10.522436 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-02b08959-f6a1-4435-bc0c-5cc8bf0c7d47 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:10.587889 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-53620d76-e6d8-4779-813a-4b064a394b9a tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "DELETE /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/os-volume_attachments/ce3c1342-9c8a-4c9e-bd48-7ab0458ea8bb" status: 202 len: 0 microversion: 2.1 time: 0.435822 Aug 02 09:18:10.588539 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 431/836] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 2 09:18:10 2022] DELETE /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/os-volume_attachments/ce3c1342-9c8a-4c9e-bd48-7ab0458ea8bb => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:18:10.782951 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-02b08959-f6a1-4435-bc0c-5cc8bf0c7d47 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:10.792286 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-02b08959-f6a1-4435-bc0c-5cc8bf0c7d47 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1267 microversion: 2.1 time: 0.285330 Aug 02 09:18:10.792898 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 406/837] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:10 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1267 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:10.989611 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-2c7c45ab-570f-4d47-8898-61c21df03cab tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:10.990574 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-2c7c45ab-570f-4d47-8898-61c21df03cab tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:10.998444 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2c7c45ab-570f-4d47-8898-61c21df03cab tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:10.999035 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2c7c45ab-570f-4d47-8898-61c21df03cab tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:11.000356 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2c7c45ab-570f-4d47-8898-61c21df03cab tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:11.001092 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2c7c45ab-570f-4d47-8898-61c21df03cab tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:11.023980 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-2c7c45ab-570f-4d47-8898-61c21df03cab tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] HTTP exception thrown: Instance b54fded6-ca19-48e6-b971-31f061cce0c5 could not be found. Aug 02 09:18:11.025738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-2c7c45ab-570f-4d47-8898-61c21df03cab tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Request method failure captured: Aug 02 09:18:11.025738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: DELETE /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 HTTP/1.1 Aug 02 09:18:11.025738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:18:11.025738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:18:11.025738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:18:11.025738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:18:11.025738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:18:11.025738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:18:11.025738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:18:11.025738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:11.025738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6OoRT2KmPOrbFwi17IerArjCVuPRvNuR_ftdfux-dglsWpzjnybStZVi73M6KoPiMnSPwswC3oPIk2nAftEkrc45NeUE0vfe39o3Ba-J-4bw7BGpvYXczGIMGnYpIRDEnnQ1Hg0tHLBummYQaRlFeZPdww-C2_01n4KUnUWFlWfKaVY Aug 02 09:18:11.025738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:18:11.025738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:18:11.025738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:18:11.025738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:18:11.025738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 09:18:11.025738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:18:11.025738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:18:11.025738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: 06061d6914ac4b86841d45162ceeb89f Aug 02 09:18:11.025738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1976077308 Aug 02 09:18:11.025738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:18:11.025738 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:18:11.027428 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/06061d6914ac4b86841d45162ceeb89f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/06061d6914ac4b86841d45162ceeb89f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/06061d6914ac4b86841d45162ceeb89f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_06061d6914ac4b86841d45162ceeb89f"}]}] Aug 02 09:18:11.027428 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1976077308 Aug 02 09:18:11.027428 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: 06061d6914ac4b86841d45162ceeb89f Aug 02 09:18:11.027428 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1976077308 Aug 02 09:18:11.027428 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-AttachVolumeShelveTestJSON-1976077308-project Aug 02 09:18:11.027428 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:18:11.027428 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:18:11.027428 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: 4a1a40ef55434cd48a2dc4385880fe0b Aug 02 09:18:11.027428 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1976077308-project Aug 02 09:18:11.027428 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: > Aug 02 09:18:11.027428 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Instance b54fded6-ca19-48e6-b971-31f061cce0c5 could not be found. Aug 02 09:18:11.027428 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': 'b54fded6-ca19-48e6-b971-31f061cce0c5'} Aug 02 09:18:11.028343 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:11.028343 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:11.028343 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:11.028343 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:11.028343 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:11.028343 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:11.028343 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:11.028343 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:11.028343 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:11.028343 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:11.028343 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b54fded6-ca19-48e6-b971-31f061cce0c5 could not be found. Aug 02 09:18:11.028343 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:11.028343 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:11.028343 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:11.028343 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:11.028343 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:11.028343 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:11.028343 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:11.028343 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:11.028343 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:11.029835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:11.029835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:18:11.029835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:18:11.029835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:18:11.029835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:18:11.029835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:11.029835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:11.029835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:11.029835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:11.029835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b54fded6-ca19-48e6-b971-31f061cce0c5 could not be found. Aug 02 09:18:11.029835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:11.029835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:11.029835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:11.029835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:11.029835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:11.029835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:11.029835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:11.029835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:11.029835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b54fded6-ca19-48e6-b971-31f061cce0c5 could not be found. Aug 02 09:18:11.029835 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:11.031998 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-2c7c45ab-570f-4d47-8898-61c21df03cab tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Returning 404 to user: Instance b54fded6-ca19-48e6-b971-31f061cce0c5 could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:11.031998 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-2c7c45ab-570f-4d47-8898-61c21df03cab tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 404 len: 111 microversion: 2.20 time: 0.044308 Aug 02 09:18:11.031998 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 432/838] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Aug 2 09:18:10 2022] DELETE /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:18:11.035773 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-de9d3b1c-0747-4755-bcaf-c73cf2b4f348 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:11.036412 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-de9d3b1c-0747-4755-bcaf-c73cf2b4f348 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: b54fded6-ca19-48e6-b971-31f061cce0c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:11.043083 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-de9d3b1c-0747-4755-bcaf-c73cf2b4f348 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:11.043536 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-de9d3b1c-0747-4755-bcaf-c73cf2b4f348 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:11.050595 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-de9d3b1c-0747-4755-bcaf-c73cf2b4f348 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:11.050595 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-de9d3b1c-0747-4755-bcaf-c73cf2b4f348 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:11.059210 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-de9d3b1c-0747-4755-bcaf-c73cf2b4f348 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] HTTP exception thrown: Instance b54fded6-ca19-48e6-b971-31f061cce0c5 could not be found. Aug 02 09:18:11.060799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-de9d3b1c-0747-4755-bcaf-c73cf2b4f348 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Request method failure captured: Aug 02 09:18:11.060799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 HTTP/1.1 Aug 02 09:18:11.060799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:18:11.060799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:18:11.060799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:18:11.060799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:18:11.060799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:18:11.060799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:18:11.060799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:18:11.060799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:11.060799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OoRT2KmPOrbFwi17IerArjCVuPRvNuR_ftdfux-dglsWpzjnybStZVi73M6KoPiMnSPwswC3oPIk2nAftEkrc45NeUE0vfe39o3Ba-J-4bw7BGpvYXczGIMGnYpIRDEnnQ1Hg0tHLBummYQaRlFeZPdww-C2_01n4KUnUWFlWfKaVY Aug 02 09:18:11.060799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:18:11.060799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:18:11.060799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:18:11.060799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:18:11.060799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 09:18:11.060799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:18:11.060799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:18:11.060799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: 06061d6914ac4b86841d45162ceeb89f Aug 02 09:18:11.060799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1976077308 Aug 02 09:18:11.060799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:18:11.060799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:18:11.062412 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/06061d6914ac4b86841d45162ceeb89f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/06061d6914ac4b86841d45162ceeb89f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/06061d6914ac4b86841d45162ceeb89f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_06061d6914ac4b86841d45162ceeb89f"}]}] Aug 02 09:18:11.062412 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1976077308 Aug 02 09:18:11.062412 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: 06061d6914ac4b86841d45162ceeb89f Aug 02 09:18:11.062412 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1976077308 Aug 02 09:18:11.062412 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-AttachVolumeShelveTestJSON-1976077308-project Aug 02 09:18:11.062412 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:18:11.062412 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:18:11.062412 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: 4a1a40ef55434cd48a2dc4385880fe0b Aug 02 09:18:11.062412 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1976077308-project Aug 02 09:18:11.062412 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:18:11.062412 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Instance b54fded6-ca19-48e6-b971-31f061cce0c5 could not be found. Aug 02 09:18:11.062412 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'id': 'b54fded6-ca19-48e6-b971-31f061cce0c5'} Aug 02 09:18:11.063206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:11.063206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:11.063206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:11.063206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:11.063206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:11.063206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:11.063206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:11.063206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:11.063206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:11.063206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:11.063206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b54fded6-ca19-48e6-b971-31f061cce0c5 could not be found. Aug 02 09:18:11.063206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:11.063206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:11.063206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:11.063206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:11.063206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:11.063206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:11.063206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:11.063206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:11.063206 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:11.064765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:11.064765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:18:11.064765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:18:11.064765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:11.064765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:11.064765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:11.064765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:11.064765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b54fded6-ca19-48e6-b971-31f061cce0c5 could not be found. Aug 02 09:18:11.064765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:11.064765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:11.064765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:11.064765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:11.064765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:11.064765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:11.064765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:11.064765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:11.064765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b54fded6-ca19-48e6-b971-31f061cce0c5 could not be found. Aug 02 09:18:11.064765 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:11.066171 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-de9d3b1c-0747-4755-bcaf-c73cf2b4f348 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Returning 404 to user: Instance b54fded6-ca19-48e6-b971-31f061cce0c5 could not be found. {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:11.066171 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-de9d3b1c-0747-4755-bcaf-c73cf2b4f348 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5" status: 404 len: 111 microversion: 2.20 time: 0.030190 Aug 02 09:18:11.066171 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 407/839] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:18:11 2022] GET /compute/v2.1/servers/b54fded6-ca19-48e6-b971-31f061cce0c5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:18:11.306955 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-6fe47c05-db19-4213-8c65-8f423468fa51 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:11.307496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-6fe47c05-db19-4213-8c65-8f423468fa51 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:11.314107 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6fe47c05-db19-4213-8c65-8f423468fa51 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:11.314553 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6fe47c05-db19-4213-8c65-8f423468fa51 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:11.315316 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6fe47c05-db19-4213-8c65-8f423468fa51 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:11.315749 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6fe47c05-db19-4213-8c65-8f423468fa51 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:11.330250 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-6fe47c05-db19-4213-8c65-8f423468fa51 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] HTTP exception thrown: Instance 4449fe97-0099-41f0-b88e-d7264a4d324c could not be found. Aug 02 09:18:11.331910 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-6fe47c05-db19-4213-8c65-8f423468fa51 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Request method failure captured: Aug 02 09:18:11.331910 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c HTTP/1.1 Aug 02 09:18:11.331910 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:18:11.331910 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:18:11.331910 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:18:11.331910 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:18:11.331910 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:18:11.331910 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:18:11.331910 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:18:11.331910 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:11.331910 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6OoKOsXfjNTp1mjsj6r1IgBAgQBzTLiQjJO0bR1TldRTpxWx6tSFZWanW3Gv02s-EY-9kVRC92iBnbzPS2ztWMdgardIrvDP60IsZABewH2eMK4dXX1f7Hpv6gsaQwPQ8jW613IMovFbfYZIhNfO_yD-aTLWmHXV3Hwct_s6HofR820 Aug 02 09:18:11.331910 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:18:11.331910 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:18:11.331910 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:18:11.331910 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:18:11.331910 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:18:11.331910 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:18:11.331910 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:18:11.331910 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:11.331910 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:18:11.331910 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:18:11.333627 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6fc6b07497a48eeb263b3a9b8aa7499"}]}] Aug 02 09:18:11.333627 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:11.333627 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:18:11.333627 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:11.333627 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:18:11.333627 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:18:11.333627 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:18:11.333627 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: ad3a9141e9284bb5a096fb04d3e9d581 Aug 02 09:18:11.333627 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:18:11.333627 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: > Aug 02 09:18:11.333627 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Instance 4449fe97-0099-41f0-b88e-d7264a4d324c could not be found. Aug 02 09:18:11.333627 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': '4449fe97-0099-41f0-b88e-d7264a4d324c'} Aug 02 09:18:11.334778 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:11.334778 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:11.334778 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:11.334778 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:11.334778 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:11.334778 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:11.334778 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:11.334778 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:11.334778 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:11.334778 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:11.334778 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4449fe97-0099-41f0-b88e-d7264a4d324c could not be found. Aug 02 09:18:11.334778 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:11.334778 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:11.334778 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:11.334778 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:11.334778 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:11.334778 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:11.334778 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:11.334778 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:11.334778 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:11.336869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:11.336869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:18:11.336869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:18:11.336869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:11.336869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:11.336869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:11.336869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:11.336869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4449fe97-0099-41f0-b88e-d7264a4d324c could not be found. Aug 02 09:18:11.336869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:11.336869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:11.336869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:11.336869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:11.336869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:11.336869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:11.336869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:11.336869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:11.336869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4449fe97-0099-41f0-b88e-d7264a4d324c could not be found. Aug 02 09:18:11.336869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:11.338195 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-6fe47c05-db19-4213-8c65-8f423468fa51 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Returning 404 to user: Instance 4449fe97-0099-41f0-b88e-d7264a4d324c could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:11.338195 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-6fe47c05-db19-4213-8c65-8f423468fa51 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c" status: 404 len: 111 microversion: 2.1 time: 0.030659 Aug 02 09:18:11.338195 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 433/840] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:11 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:18:11.343339 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-0fbc501b-509a-4cf7-9322-d3dcef839c81 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '.version_select at 0x7ffb9a984d30>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:11.451355 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-0fbc501b-509a-4cf7-9322-d3dcef839c81 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-130336248" status: 202 len: 0 microversion: 2.1 time: 0.111849 Aug 02 09:18:11.452299 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 408/841] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Aug 2 09:18:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-130336248 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:18:11.829505 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-5e2ebffd-fdc7-4e34-848d-b93d602a9332 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:11.830404 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-5e2ebffd-fdc7-4e34-848d-b93d602a9332 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:11.837996 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5e2ebffd-fdc7-4e34-848d-b93d602a9332 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:11.838903 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5e2ebffd-fdc7-4e34-848d-b93d602a9332 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:11.840019 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5e2ebffd-fdc7-4e34-848d-b93d602a9332 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:11.840679 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5e2ebffd-fdc7-4e34-848d-b93d602a9332 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:12.039415 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-5e2ebffd-fdc7-4e34-848d-b93d602a9332 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:12.048464 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-5e2ebffd-fdc7-4e34-848d-b93d602a9332 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1267 microversion: 2.1 time: 0.224552 Aug 02 09:18:12.062635 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 434/842] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:11 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1267 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:12.540023 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a76f44b2-f04e-4242-a96f-43e7139d1a30 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:12.540750 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-a76f44b2-f04e-4242-a96f-43e7139d1a30 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:12.559162 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a76f44b2-f04e-4242-a96f-43e7139d1a30 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:12.561823 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a76f44b2-f04e-4242-a96f-43e7139d1a30 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:12.562870 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a76f44b2-f04e-4242-a96f-43e7139d1a30 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:12.565752 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a76f44b2-f04e-4242-a96f-43e7139d1a30 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:12.602981 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-a76f44b2-f04e-4242-a96f-43e7139d1a30 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] HTTP exception thrown: Instance 6cca7c83-368d-4c02-a00c-d12a84825c27 could not be found. Aug 02 09:18:12.609734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a76f44b2-f04e-4242-a96f-43e7139d1a30 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Request method failure captured: Aug 02 09:18:12.609734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: DELETE /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 HTTP/1.1 Aug 02 09:18:12.609734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:18:12.609734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:18:12.609734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:18:12.609734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:18:12.609734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:18:12.609734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:18:12.609734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:18:12.609734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:12.609734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OoRT2KmPOrbFwi17IerArjCVuPRvNuR_ftdfux-dglsWpzjnybStZVi73M6KoPiMnSPwswC3oPIk2nAftEkrc45NeUE0vfe39o3Ba-J-4bw7BGpvYXczGIMGnYpIRDEnnQ1Hg0tHLBummYQaRlFeZPdww-C2_01n4KUnUWFlWfKaVY Aug 02 09:18:12.609734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:18:12.609734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:18:12.609734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:18:12.609734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:18:12.609734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 09:18:12.609734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:18:12.609734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:18:12.609734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: 06061d6914ac4b86841d45162ceeb89f Aug 02 09:18:12.609734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1976077308 Aug 02 09:18:12.609734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:18:12.609734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:18:12.621772 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/06061d6914ac4b86841d45162ceeb89f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/06061d6914ac4b86841d45162ceeb89f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/06061d6914ac4b86841d45162ceeb89f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_06061d6914ac4b86841d45162ceeb89f"}]}] Aug 02 09:18:12.621772 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1976077308 Aug 02 09:18:12.621772 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: 06061d6914ac4b86841d45162ceeb89f Aug 02 09:18:12.621772 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1976077308 Aug 02 09:18:12.621772 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-AttachVolumeShelveTestJSON-1976077308-project Aug 02 09:18:12.621772 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:18:12.621772 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:18:12.621772 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: 4a1a40ef55434cd48a2dc4385880fe0b Aug 02 09:18:12.621772 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1976077308-project Aug 02 09:18:12.621772 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:18:12.621772 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Instance 6cca7c83-368d-4c02-a00c-d12a84825c27 could not be found. Aug 02 09:18:12.621772 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'id': '6cca7c83-368d-4c02-a00c-d12a84825c27'} Aug 02 09:18:12.623183 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:12.623183 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:12.623183 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:12.623183 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:12.623183 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:12.623183 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:12.623183 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:12.623183 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:12.623183 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:12.623183 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:12.623183 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cca7c83-368d-4c02-a00c-d12a84825c27 could not be found. Aug 02 09:18:12.623183 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:12.623183 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:12.623183 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:12.623183 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:12.623183 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:12.623183 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:12.623183 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:12.623183 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:12.623183 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:12.624717 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:12.624717 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:18:12.624717 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:18:12.624717 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:18:12.624717 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:18:12.624717 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:12.624717 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:12.624717 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:12.624717 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:12.624717 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cca7c83-368d-4c02-a00c-d12a84825c27 could not be found. Aug 02 09:18:12.624717 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:12.624717 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:12.624717 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:12.624717 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:12.624717 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:12.624717 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:12.624717 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:12.624717 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:12.624717 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cca7c83-368d-4c02-a00c-d12a84825c27 could not be found. Aug 02 09:18:12.624717 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:12.626191 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a76f44b2-f04e-4242-a96f-43e7139d1a30 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Returning 404 to user: Instance 6cca7c83-368d-4c02-a00c-d12a84825c27 could not be found. {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:12.626191 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-a76f44b2-f04e-4242-a96f-43e7139d1a30 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 404 len: 111 microversion: 2.20 time: 0.077916 Aug 02 09:18:12.626191 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 409/843] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Aug 2 09:18:12 2022] DELETE /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:18:12.632741 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-8fcfff67-f10e-44c0-8ea1-6681dc78e9b3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:12.633419 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-8fcfff67-f10e-44c0-8ea1-6681dc78e9b3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] [instance: 6cca7c83-368d-4c02-a00c-d12a84825c27] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:12.646944 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8fcfff67-f10e-44c0-8ea1-6681dc78e9b3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:12.648804 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8fcfff67-f10e-44c0-8ea1-6681dc78e9b3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:12.649167 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8fcfff67-f10e-44c0-8ea1-6681dc78e9b3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:12.649614 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8fcfff67-f10e-44c0-8ea1-6681dc78e9b3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:12.669683 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-8fcfff67-f10e-44c0-8ea1-6681dc78e9b3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] HTTP exception thrown: Instance 6cca7c83-368d-4c02-a00c-d12a84825c27 could not be found. Aug 02 09:18:12.671709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-8fcfff67-f10e-44c0-8ea1-6681dc78e9b3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Request method failure captured: Aug 02 09:18:12.671709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 HTTP/1.1 Aug 02 09:18:12.671709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:18:12.671709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:18:12.671709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:18:12.671709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:18:12.671709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:18:12.671709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:18:12.671709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:18:12.671709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:12.671709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6OoRT2KmPOrbFwi17IerArjCVuPRvNuR_ftdfux-dglsWpzjnybStZVi73M6KoPiMnSPwswC3oPIk2nAftEkrc45NeUE0vfe39o3Ba-J-4bw7BGpvYXczGIMGnYpIRDEnnQ1Hg0tHLBummYQaRlFeZPdww-C2_01n4KUnUWFlWfKaVY Aug 02 09:18:12.671709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:18:12.671709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:18:12.671709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:18:12.671709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:18:12.671709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Openstack-Nova-Api-Version: 2.20 Aug 02 09:18:12.671709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:18:12.671709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:18:12.671709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: 06061d6914ac4b86841d45162ceeb89f Aug 02 09:18:12.671709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1976077308 Aug 02 09:18:12.671709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:18:12.671709 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:18:12.673389 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/06061d6914ac4b86841d45162ceeb89f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/06061d6914ac4b86841d45162ceeb89f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/06061d6914ac4b86841d45162ceeb89f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_06061d6914ac4b86841d45162ceeb89f"}]}] Aug 02 09:18:12.673389 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1976077308 Aug 02 09:18:12.673389 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: 06061d6914ac4b86841d45162ceeb89f Aug 02 09:18:12.673389 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1976077308 Aug 02 09:18:12.673389 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-AttachVolumeShelveTestJSON-1976077308-project Aug 02 09:18:12.673389 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:18:12.673389 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:18:12.673389 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: 4a1a40ef55434cd48a2dc4385880fe0b Aug 02 09:18:12.673389 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1976077308-project Aug 02 09:18:12.673389 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: > Aug 02 09:18:12.673389 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Instance 6cca7c83-368d-4c02-a00c-d12a84825c27 could not be found. Aug 02 09:18:12.673389 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': '6cca7c83-368d-4c02-a00c-d12a84825c27'} Aug 02 09:18:12.674263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:12.674263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:12.674263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:12.674263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:12.674263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:12.674263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:12.674263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:12.674263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:12.674263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:12.674263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:12.674263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cca7c83-368d-4c02-a00c-d12a84825c27 could not be found. Aug 02 09:18:12.674263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:12.674263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:12.674263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:12.674263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:12.674263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:12.674263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:12.674263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:12.674263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:12.674263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:12.675769 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:12.675769 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:18:12.675769 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:18:12.675769 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:12.675769 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:12.675769 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:12.675769 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:12.675769 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cca7c83-368d-4c02-a00c-d12a84825c27 could not be found. Aug 02 09:18:12.675769 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:12.675769 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:12.675769 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:12.675769 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:12.675769 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:12.675769 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:12.675769 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:12.675769 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:12.675769 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cca7c83-368d-4c02-a00c-d12a84825c27 could not be found. Aug 02 09:18:12.675769 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:12.678050 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-8fcfff67-f10e-44c0-8ea1-6681dc78e9b3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] Returning 404 to user: Instance 6cca7c83-368d-4c02-a00c-d12a84825c27 could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:12.679799 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-8fcfff67-f10e-44c0-8ea1-6681dc78e9b3 tempest-AttachVolumeShelveTestJSON-1976077308 tempest-AttachVolumeShelveTestJSON-1976077308-project] 10.222.0.20 "GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27" status: 404 len: 111 microversion: 2.20 time: 0.051309 Aug 02 09:18:12.681150 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 435/844] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 2 09:18:12 2022] GET /compute/v2.1/servers/6cca7c83-368d-4c02-a00c-d12a84825c27 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 02 09:18:12.903592 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b5b1cc87-ba14-457b-8f13-444a7d709a24 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:12.907102 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b5b1cc87-ba14-457b-8f13-444a7d709a24 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:12.915903 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b5b1cc87-ba14-457b-8f13-444a7d709a24 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:12.916679 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b5b1cc87-ba14-457b-8f13-444a7d709a24 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:12.917696 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b5b1cc87-ba14-457b-8f13-444a7d709a24 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:12.918285 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b5b1cc87-ba14-457b-8f13-444a7d709a24 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:12.968715 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b5b1cc87-ba14-457b-8f13-444a7d709a24 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070428 Aug 02 09:18:12.969600 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 410/845] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:18:12 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 02 09:18:13.078258 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d95fdb12-63c3-40d0-8786-6c6d23a0941c tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:13.079533 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-d95fdb12-63c3-40d0-8786-6c6d23a0941c tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:13.090772 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d95fdb12-63c3-40d0-8786-6c6d23a0941c tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:13.091586 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d95fdb12-63c3-40d0-8786-6c6d23a0941c tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:13.092642 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d95fdb12-63c3-40d0-8786-6c6d23a0941c tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:13.093285 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d95fdb12-63c3-40d0-8786-6c6d23a0941c tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:13.142101 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-46cc577f-a17e-4ce2-aebb-bd40c4a3c1a3 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:13.148415 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-46cc577f-a17e-4ce2-aebb-bd40c4a3c1a3 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:13.156682 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-46cc577f-a17e-4ce2-aebb-bd40c4a3c1a3 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:13.157369 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-46cc577f-a17e-4ce2-aebb-bd40c4a3c1a3 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:13.158372 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-46cc577f-a17e-4ce2-aebb-bd40c4a3c1a3 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:13.158990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-46cc577f-a17e-4ce2-aebb-bd40c4a3c1a3 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:13.207899 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-46cc577f-a17e-4ce2-aebb-bd40c4a3c1a3 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070209 Aug 02 09:18:13.208536 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 411/846] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:18:13 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 09:18:13.291167 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-43a413cd-3183-468f-ab2a-63d72160fc45 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:13.291897 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-43a413cd-3183-468f-ab2a-63d72160fc45 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:13.300588 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-43a413cd-3183-468f-ab2a-63d72160fc45 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:13.301386 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-43a413cd-3183-468f-ab2a-63d72160fc45 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:13.302470 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-43a413cd-3183-468f-ab2a-63d72160fc45 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:13.302911 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-43a413cd-3183-468f-ab2a-63d72160fc45 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:13.338794 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-43a413cd-3183-468f-ab2a-63d72160fc45 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Going to try to terminate instance {{(pid=118526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:18:13.519369 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d95fdb12-63c3-40d0-8786-6c6d23a0941c tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:13.532607 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-d95fdb12-63c3-40d0-8786-6c6d23a0941c tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1267 microversion: 2.1 time: 0.465223 Aug 02 09:18:13.539729 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 436/847] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:13 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1267 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:13.769916 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-43a413cd-3183-468f-ab2a-63d72160fc45 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "DELETE /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be" status: 204 len: 0 microversion: 2.1 time: 0.476419 Aug 02 09:18:13.769916 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 412/848] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:18:13 2022] DELETE /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 02 09:18:13.772725 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-30054dcd-a3df-4811-8a4a-3fdac415053f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:13.773927 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-30054dcd-a3df-4811-8a4a-3fdac415053f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:13.781270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-30054dcd-a3df-4811-8a4a-3fdac415053f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:13.782066 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-30054dcd-a3df-4811-8a4a-3fdac415053f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:13.782851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-30054dcd-a3df-4811-8a4a-3fdac415053f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:13.783543 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-30054dcd-a3df-4811-8a4a-3fdac415053f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:13.973393 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b28182e5-c2e6-4a34-a4cd-fe4ca4aed498 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:13.974278 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b28182e5-c2e6-4a34-a4cd-fe4ca4aed498 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:13.982347 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b28182e5-c2e6-4a34-a4cd-fe4ca4aed498 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:13.982347 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b28182e5-c2e6-4a34-a4cd-fe4ca4aed498 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:13.982869 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b28182e5-c2e6-4a34-a4cd-fe4ca4aed498 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:13.983327 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b28182e5-c2e6-4a34-a4cd-fe4ca4aed498 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:13.998811 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-b28182e5-c2e6-4a34-a4cd-fe4ca4aed498 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] HTTP exception thrown: Instance 4449fe97-0099-41f0-b88e-d7264a4d324c could not be found. Aug 02 09:18:14.000519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b28182e5-c2e6-4a34-a4cd-fe4ca4aed498 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Request method failure captured: Aug 02 09:18:14.000519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: DELETE /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c HTTP/1.1 Aug 02 09:18:14.000519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:18:14.000519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:18:14.000519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:18:14.000519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:18:14.000519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:18:14.000519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:18:14.000519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:18:14.000519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:14.000519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OoKOsXfjNTp1mjsj6r1IgBAgQBzTLiQjJO0bR1TldRTpxWx6tSFZWanW3Gv02s-EY-9kVRC92iBnbzPS2ztWMdgardIrvDP60IsZABewH2eMK4dXX1f7Hpv6gsaQwPQ8jW613IMovFbfYZIhNfO_yD-aTLWmHXV3Hwct_s6HofR820 Aug 02 09:18:14.000519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:18:14.000519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:18:14.000519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:18:14.000519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:18:14.000519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:18:14.000519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:18:14.000519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:18:14.000519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:14.000519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:18:14.000519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:18:14.002394 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6fc6b07497a48eeb263b3a9b8aa7499"}]}] Aug 02 09:18:14.002394 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:14.002394 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:18:14.002394 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:14.002394 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:18:14.002394 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:18:14.002394 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:18:14.002394 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: ad3a9141e9284bb5a096fb04d3e9d581 Aug 02 09:18:14.002394 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:18:14.002394 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:18:14.002394 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Instance 4449fe97-0099-41f0-b88e-d7264a4d324c could not be found. Aug 02 09:18:14.002394 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'id': '4449fe97-0099-41f0-b88e-d7264a4d324c'} Aug 02 09:18:14.003142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:14.003142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:14.003142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:14.003142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:14.003142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:14.003142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:14.003142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:14.003142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:14.003142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:14.003142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:14.003142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4449fe97-0099-41f0-b88e-d7264a4d324c could not be found. Aug 02 09:18:14.003142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:14.003142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:14.003142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:14.003142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:14.003142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:14.003142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:14.003142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:14.003142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:14.003142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:14.004511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:14.004511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:18:14.004511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:18:14.004511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:18:14.004511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:18:14.004511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:14.004511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:14.004511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:14.004511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:14.004511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4449fe97-0099-41f0-b88e-d7264a4d324c could not be found. Aug 02 09:18:14.004511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:14.004511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:14.004511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:14.004511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:14.004511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:14.004511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:14.004511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:14.004511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:14.004511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4449fe97-0099-41f0-b88e-d7264a4d324c could not be found. Aug 02 09:18:14.004511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:14.011566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b28182e5-c2e6-4a34-a4cd-fe4ca4aed498 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Returning 404 to user: Instance 4449fe97-0099-41f0-b88e-d7264a4d324c could not be found. {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:14.011566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b28182e5-c2e6-4a34-a4cd-fe4ca4aed498 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c" status: 404 len: 111 microversion: 2.1 time: 0.032815 Aug 02 09:18:14.011566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 413/849] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:18:13 2022] DELETE /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 09:18:14.011814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-ab137fa4-4079-4bee-b1d1-c452879be3d9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:14.012546 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-ab137fa4-4079-4bee-b1d1-c452879be3d9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 4449fe97-0099-41f0-b88e-d7264a4d324c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:14.023567 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ab137fa4-4079-4bee-b1d1-c452879be3d9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:14.024021 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ab137fa4-4079-4bee-b1d1-c452879be3d9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:14.025258 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ab137fa4-4079-4bee-b1d1-c452879be3d9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:14.025786 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ab137fa4-4079-4bee-b1d1-c452879be3d9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:14.029530 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:14.065410 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-ab137fa4-4079-4bee-b1d1-c452879be3d9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] HTTP exception thrown: Instance 4449fe97-0099-41f0-b88e-d7264a4d324c could not be found. Aug 02 09:18:14.067194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-ab137fa4-4079-4bee-b1d1-c452879be3d9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Request method failure captured: Aug 02 09:18:14.067194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c HTTP/1.1 Aug 02 09:18:14.067194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:18:14.067194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:18:14.067194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:18:14.067194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:18:14.067194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:18:14.067194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:18:14.067194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:18:14.067194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:14.067194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OoKOsXfjNTp1mjsj6r1IgBAgQBzTLiQjJO0bR1TldRTpxWx6tSFZWanW3Gv02s-EY-9kVRC92iBnbzPS2ztWMdgardIrvDP60IsZABewH2eMK4dXX1f7Hpv6gsaQwPQ8jW613IMovFbfYZIhNfO_yD-aTLWmHXV3Hwct_s6HofR820 Aug 02 09:18:14.067194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:18:14.067194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:18:14.067194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:18:14.067194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:18:14.067194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:18:14.067194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:18:14.067194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:18:14.067194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:14.067194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:18:14.067194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:18:14.068920 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6fc6b07497a48eeb263b3a9b8aa7499"}]}] Aug 02 09:18:14.068920 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:14.068920 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:18:14.068920 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:14.068920 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:18:14.068920 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:18:14.068920 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:18:14.068920 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: ad3a9141e9284bb5a096fb04d3e9d581 Aug 02 09:18:14.068920 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:18:14.068920 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:18:14.068920 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Instance 4449fe97-0099-41f0-b88e-d7264a4d324c could not be found. Aug 02 09:18:14.068920 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'id': '4449fe97-0099-41f0-b88e-d7264a4d324c'} Aug 02 09:18:14.070326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:14.070326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:14.070326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:14.070326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:14.070326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:14.070326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:14.070326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:14.070326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:14.070326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:14.070326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:14.070326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4449fe97-0099-41f0-b88e-d7264a4d324c could not be found. Aug 02 09:18:14.070326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:14.070326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:14.070326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:14.070326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:14.070326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:14.070326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:14.070326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:14.070326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:14.070326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:14.071847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:14.071847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:18:14.071847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:18:14.071847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:14.071847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:14.071847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:14.071847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:14.071847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4449fe97-0099-41f0-b88e-d7264a4d324c could not be found. Aug 02 09:18:14.071847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:14.071847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:14.071847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:14.071847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:14.071847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:14.071847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:14.071847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:14.071847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:14.071847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4449fe97-0099-41f0-b88e-d7264a4d324c could not be found. Aug 02 09:18:14.071847 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:14.074735 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-ab137fa4-4079-4bee-b1d1-c452879be3d9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Returning 404 to user: Instance 4449fe97-0099-41f0-b88e-d7264a4d324c could not be found. {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:14.074735 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-ab137fa4-4079-4bee-b1d1-c452879be3d9 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c" status: 404 len: 111 microversion: 2.1 time: 0.062835 Aug 02 09:18:14.074735 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 414/850] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:14 2022] GET /compute/v2.1/servers/4449fe97-0099-41f0-b88e-d7264a4d324c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 09:18:14.094352 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-30054dcd-a3df-4811-8a4a-3fdac415053f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:14.111322 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-30054dcd-a3df-4811-8a4a-3fdac415053f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be" status: 200 len: 1671 microversion: 2.1 time: 0.341857 Aug 02 09:18:14.113425 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 437/851] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:13 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be => generated 1671 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:14.151905 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-9cfe09f0-c98e-478b-9915-7675f23ea5ad tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:14.152451 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-9cfe09f0-c98e-478b-9915-7675f23ea5ad tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:14.167243 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9cfe09f0-c98e-478b-9915-7675f23ea5ad tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:14.168526 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9cfe09f0-c98e-478b-9915-7675f23ea5ad tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:14.170227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9cfe09f0-c98e-478b-9915-7675f23ea5ad tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:14.170700 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9cfe09f0-c98e-478b-9915-7675f23ea5ad tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:14.175127 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-e87e668e-e459-46e4-aad0-c84baf49d6c6 req-9fa397dd-5564-4d19-9b16-84668a105128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c36b6524-980c-4f56-b1ad-e71536c08577", "tag": "541f0637-de44-45f3-b1dd-7b7924d55993"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:14.191970 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-e87e668e-e459-46e4-aad0-c84baf49d6c6 req-9fa397dd-5564-4d19-9b16-84668a105128 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:14.193176 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-e87e668e-e459-46e4-aad0-c84baf49d6c6 req-9fa397dd-5564-4d19-9b16-84668a105128 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:14.208534 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-9cfe09f0-c98e-478b-9915-7675f23ea5ad tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Going to try to terminate instance {{(pid=118526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:18:14.234257 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-e87e668e-e459-46e4-aad0-c84baf49d6c6 req-9fa397dd-5564-4d19-9b16-84668a105128 service nova] Creating event network-changed:541f0637-de44-45f3-b1dd-7b7924d55993 for instance c36b6524-980c-4f56-b1ad-e71536c08577 on hv-cinder-84599 Aug 02 09:18:14.265271 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-e87e668e-e459-46e4-aad0-c84baf49d6c6 req-9fa397dd-5564-4d19-9b16-84668a105128 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082090 Aug 02 09:18:14.271533 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 438/852] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:14.567154 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-6da7f2ef-cff8-4603-98e5-9147c490e9c4 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:14.571997 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-6da7f2ef-cff8-4603-98e5-9147c490e9c4 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:14.601958 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6da7f2ef-cff8-4603-98e5-9147c490e9c4 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:14.606880 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6da7f2ef-cff8-4603-98e5-9147c490e9c4 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:14.608452 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6da7f2ef-cff8-4603-98e5-9147c490e9c4 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:14.609151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6da7f2ef-cff8-4603-98e5-9147c490e9c4 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:14.889842 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-6da7f2ef-cff8-4603-98e5-9147c490e9c4 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:14.903071 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-9cfe09f0-c98e-478b-9915-7675f23ea5ad tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 204 len: 0 microversion: 2.1 time: 0.752898 Aug 02 09:18:14.913166 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-6da7f2ef-cff8-4603-98e5-9147c490e9c4 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1267 microversion: 2.1 time: 0.356826 Aug 02 09:18:14.914561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 415/853] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:18:14 2022] DELETE /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:18:14.934369 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-3bbaedc6-533e-42dc-871c-feba881f7f7d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:14.936304 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-3bbaedc6-533e-42dc-871c-feba881f7f7d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:14.943721 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 439/854] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:14 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1267 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:14.950577 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3bbaedc6-533e-42dc-871c-feba881f7f7d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:14.951909 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3bbaedc6-533e-42dc-871c-feba881f7f7d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:14.953716 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3bbaedc6-533e-42dc-871c-feba881f7f7d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:14.955145 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3bbaedc6-533e-42dc-871c-feba881f7f7d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:15.152037 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-13526262-030f-4c5d-ac68-267e5bfae0ec tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:15.152698 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-13526262-030f-4c5d-ac68-267e5bfae0ec tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:15.158271 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-3bbaedc6-533e-42dc-871c-feba881f7f7d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:15.165300 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-13526262-030f-4c5d-ac68-267e5bfae0ec tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:15.166523 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-13526262-030f-4c5d-ac68-267e5bfae0ec tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:15.167770 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-13526262-030f-4c5d-ac68-267e5bfae0ec tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:15.168829 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-13526262-030f-4c5d-ac68-267e5bfae0ec tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:15.169858 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-3bbaedc6-533e-42dc-871c-feba881f7f7d tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1567 microversion: 2.1 time: 0.249320 Aug 02 09:18:15.172266 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 416/855] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:14 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:15.583700 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-fd76f665-2fc0-440f-9416-927a96d198f0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:15.588870 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-fd76f665-2fc0-440f-9416-927a96d198f0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:15.597484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-13526262-030f-4c5d-ac68-267e5bfae0ec tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:15.617825 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-13526262-030f-4c5d-ac68-267e5bfae0ec tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be" status: 200 len: 1671 microversion: 2.1 time: 0.470056 Aug 02 09:18:15.622202 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 440/856] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:15 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be => generated 1671 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:15.639046 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fd76f665-2fc0-440f-9416-927a96d198f0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:15.639723 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fd76f665-2fc0-440f-9416-927a96d198f0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:15.644205 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fd76f665-2fc0-440f-9416-927a96d198f0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:15.644714 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fd76f665-2fc0-440f-9416-927a96d198f0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:15.692208 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-fd76f665-2fc0-440f-9416-927a96d198f0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] HTTP exception thrown: Instance 0331a7cf-074f-4e27-b452-e057f9b422c5 could not be found. Aug 02 09:18:15.696025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-fd76f665-2fc0-440f-9416-927a96d198f0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Request method failure captured: Aug 02 09:18:15.696025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: DELETE /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 HTTP/1.1 Aug 02 09:18:15.696025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:18:15.696025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:18:15.696025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:18:15.696025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:18:15.696025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:18:15.696025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:18:15.696025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:18:15.696025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:15.696025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OoKOsXfjNTp1mjsj6r1IgBAgQBzTLiQjJO0bR1TldRTpxWx6tSFZWanW3Gv02s-EY-9kVRC92iBnbzPS2ztWMdgardIrvDP60IsZABewH2eMK4dXX1f7Hpv6gsaQwPQ8jW613IMovFbfYZIhNfO_yD-aTLWmHXV3Hwct_s6HofR820 Aug 02 09:18:15.696025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:18:15.696025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:18:15.696025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:18:15.696025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:18:15.696025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:18:15.696025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:18:15.696025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:18:15.696025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:15.696025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:18:15.696025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:18:15.698116 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6fc6b07497a48eeb263b3a9b8aa7499"}]}] Aug 02 09:18:15.698116 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:15.698116 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:18:15.698116 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:15.698116 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:18:15.698116 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:18:15.698116 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:18:15.698116 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: ad3a9141e9284bb5a096fb04d3e9d581 Aug 02 09:18:15.698116 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:18:15.698116 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:18:15.698116 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Instance 0331a7cf-074f-4e27-b452-e057f9b422c5 could not be found. Aug 02 09:18:15.698116 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'id': '0331a7cf-074f-4e27-b452-e057f9b422c5'} Aug 02 09:18:15.699125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:15.699125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:15.699125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:15.699125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:15.699125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:15.699125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:15.699125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:15.699125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:15.699125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:15.699125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:15.699125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0331a7cf-074f-4e27-b452-e057f9b422c5 could not be found. Aug 02 09:18:15.699125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:15.699125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:15.699125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:15.699125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:15.699125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:15.699125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:15.699125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:15.699125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:15.699125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:15.701156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:15.701156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:18:15.701156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:18:15.701156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:18:15.701156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:18:15.701156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:15.701156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:15.701156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:15.701156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:15.701156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0331a7cf-074f-4e27-b452-e057f9b422c5 could not be found. Aug 02 09:18:15.701156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:15.701156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:15.701156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:15.701156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:15.701156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:15.701156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:15.701156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:15.701156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:15.701156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0331a7cf-074f-4e27-b452-e057f9b422c5 could not be found. Aug 02 09:18:15.701156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:15.705562 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-fd76f665-2fc0-440f-9416-927a96d198f0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Returning 404 to user: Instance 0331a7cf-074f-4e27-b452-e057f9b422c5 could not be found. {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:15.715965 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-fd76f665-2fc0-440f-9416-927a96d198f0 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 404 len: 111 microversion: 2.1 time: 0.138085 Aug 02 09:18:15.717131 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 417/857] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:18:15 2022] DELETE /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 02 09:18:15.730406 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-98663ab7-b15a-49a7-b083-128b41e2ad3d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:15.731394 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-98663ab7-b15a-49a7-b083-128b41e2ad3d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0331a7cf-074f-4e27-b452-e057f9b422c5] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:15.741012 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-98663ab7-b15a-49a7-b083-128b41e2ad3d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:15.742205 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-98663ab7-b15a-49a7-b083-128b41e2ad3d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:15.743262 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-98663ab7-b15a-49a7-b083-128b41e2ad3d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:15.744794 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-98663ab7-b15a-49a7-b083-128b41e2ad3d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:15.770922 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-98663ab7-b15a-49a7-b083-128b41e2ad3d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] HTTP exception thrown: Instance 0331a7cf-074f-4e27-b452-e057f9b422c5 could not be found. Aug 02 09:18:15.775359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-98663ab7-b15a-49a7-b083-128b41e2ad3d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Request method failure captured: Aug 02 09:18:15.775359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 HTTP/1.1 Aug 02 09:18:15.775359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:18:15.775359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:18:15.775359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:18:15.775359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:18:15.775359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:18:15.775359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:18:15.775359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:18:15.775359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:15.775359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6OoKOsXfjNTp1mjsj6r1IgBAgQBzTLiQjJO0bR1TldRTpxWx6tSFZWanW3Gv02s-EY-9kVRC92iBnbzPS2ztWMdgardIrvDP60IsZABewH2eMK4dXX1f7Hpv6gsaQwPQ8jW613IMovFbfYZIhNfO_yD-aTLWmHXV3Hwct_s6HofR820 Aug 02 09:18:15.775359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:18:15.775359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:18:15.775359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:18:15.775359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:18:15.775359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:18:15.775359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:18:15.775359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:18:15.775359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:15.775359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:18:15.775359 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:18:15.776926 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6fc6b07497a48eeb263b3a9b8aa7499"}]}] Aug 02 09:18:15.776926 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:15.776926 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:18:15.776926 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:15.776926 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:18:15.776926 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:18:15.776926 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:18:15.776926 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: ad3a9141e9284bb5a096fb04d3e9d581 Aug 02 09:18:15.776926 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:18:15.776926 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: > Aug 02 09:18:15.776926 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Instance 0331a7cf-074f-4e27-b452-e057f9b422c5 could not be found. Aug 02 09:18:15.776926 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': '0331a7cf-074f-4e27-b452-e057f9b422c5'} Aug 02 09:18:15.777833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:15.777833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:15.777833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:15.777833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:15.777833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:15.777833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:15.777833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:15.777833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:15.777833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:15.777833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:15.777833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0331a7cf-074f-4e27-b452-e057f9b422c5 could not be found. Aug 02 09:18:15.777833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:15.777833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:15.777833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:15.777833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:15.777833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:15.777833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:15.777833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:15.777833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:15.777833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:15.779179 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:15.779179 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:18:15.779179 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:18:15.779179 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:15.779179 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:15.779179 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:15.779179 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:15.779179 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0331a7cf-074f-4e27-b452-e057f9b422c5 could not be found. Aug 02 09:18:15.779179 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:15.779179 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:15.779179 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:15.779179 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:15.779179 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:15.779179 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:15.779179 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:15.779179 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:15.779179 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0331a7cf-074f-4e27-b452-e057f9b422c5 could not be found. Aug 02 09:18:15.779179 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:15.791989 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-98663ab7-b15a-49a7-b083-128b41e2ad3d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Returning 404 to user: Instance 0331a7cf-074f-4e27-b452-e057f9b422c5 could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:15.791989 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-98663ab7-b15a-49a7-b083-128b41e2ad3d tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5" status: 404 len: 111 microversion: 2.1 time: 0.063168 Aug 02 09:18:15.791989 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 441/858] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:15 2022] GET /compute/v2.1/servers/0331a7cf-074f-4e27-b452-e057f9b422c5 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:18:15.799372 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-abd4de34-fad3-475f-9d51-74e9b8c48152 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:15.800225 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-abd4de34-fad3-475f-9d51-74e9b8c48152 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:15.820424 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-abd4de34-fad3-475f-9d51-74e9b8c48152 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:15.820899 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-abd4de34-fad3-475f-9d51-74e9b8c48152 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:15.822634 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-abd4de34-fad3-475f-9d51-74e9b8c48152 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:15.823328 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-abd4de34-fad3-475f-9d51-74e9b8c48152 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:15.841279 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-abd4de34-fad3-475f-9d51-74e9b8c48152 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] HTTP exception thrown: Instance 0cc9a7eb-eb1a-4b92-a548-da35114c2912 could not be found. Aug 02 09:18:15.842961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-abd4de34-fad3-475f-9d51-74e9b8c48152 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Request method failure captured: Aug 02 09:18:15.842961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: DELETE /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 HTTP/1.1 Aug 02 09:18:15.842961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:18:15.842961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:18:15.842961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:18:15.842961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:18:15.842961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:18:15.842961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:18:15.842961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:18:15.842961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:15.842961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OoKOsXfjNTp1mjsj6r1IgBAgQBzTLiQjJO0bR1TldRTpxWx6tSFZWanW3Gv02s-EY-9kVRC92iBnbzPS2ztWMdgardIrvDP60IsZABewH2eMK4dXX1f7Hpv6gsaQwPQ8jW613IMovFbfYZIhNfO_yD-aTLWmHXV3Hwct_s6HofR820 Aug 02 09:18:15.842961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:18:15.842961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:18:15.842961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:18:15.842961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:18:15.842961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:18:15.842961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:18:15.842961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:18:15.842961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:15.842961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:18:15.842961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:18:15.849455 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6fc6b07497a48eeb263b3a9b8aa7499"}]}] Aug 02 09:18:15.849455 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:15.849455 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:18:15.849455 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:15.849455 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:18:15.849455 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:18:15.849455 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:18:15.849455 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: ad3a9141e9284bb5a096fb04d3e9d581 Aug 02 09:18:15.849455 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:18:15.849455 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:18:15.849455 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Instance 0cc9a7eb-eb1a-4b92-a548-da35114c2912 could not be found. Aug 02 09:18:15.849455 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'id': '0cc9a7eb-eb1a-4b92-a548-da35114c2912'} Aug 02 09:18:15.851227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:15.851227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:15.851227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:15.851227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:15.851227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:15.851227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:15.851227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:15.851227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:15.851227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:15.851227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:15.851227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cc9a7eb-eb1a-4b92-a548-da35114c2912 could not be found. Aug 02 09:18:15.851227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:15.851227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:15.851227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:15.851227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:15.851227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:15.851227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:15.851227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:15.851227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:15.851227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:15.860679 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:15.860679 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:18:15.860679 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:18:15.860679 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:18:15.860679 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:18:15.860679 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:15.860679 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:15.860679 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:15.860679 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:15.860679 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cc9a7eb-eb1a-4b92-a548-da35114c2912 could not be found. Aug 02 09:18:15.860679 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:15.860679 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:15.860679 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:15.860679 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:15.860679 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:15.860679 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:15.860679 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:15.860679 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:15.860679 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cc9a7eb-eb1a-4b92-a548-da35114c2912 could not be found. Aug 02 09:18:15.860679 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:15.869900 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-abd4de34-fad3-475f-9d51-74e9b8c48152 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Returning 404 to user: Instance 0cc9a7eb-eb1a-4b92-a548-da35114c2912 could not be found. {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:15.869900 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-abd4de34-fad3-475f-9d51-74e9b8c48152 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 404 len: 111 microversion: 2.1 time: 0.052874 Aug 02 09:18:15.869900 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 418/859] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:18:15 2022] DELETE /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:18:15.870128 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-5001ae87-44d9-40e3-8400-12aeadc57085 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:15.870128 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-5001ae87-44d9-40e3-8400-12aeadc57085 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: 0cc9a7eb-eb1a-4b92-a548-da35114c2912] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:15.872931 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5001ae87-44d9-40e3-8400-12aeadc57085 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:15.873383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5001ae87-44d9-40e3-8400-12aeadc57085 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:15.874203 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5001ae87-44d9-40e3-8400-12aeadc57085 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:15.874728 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5001ae87-44d9-40e3-8400-12aeadc57085 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:15.918410 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-5001ae87-44d9-40e3-8400-12aeadc57085 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] HTTP exception thrown: Instance 0cc9a7eb-eb1a-4b92-a548-da35114c2912 could not be found. Aug 02 09:18:15.926052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-5001ae87-44d9-40e3-8400-12aeadc57085 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Request method failure captured: Aug 02 09:18:15.926052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 HTTP/1.1 Aug 02 09:18:15.926052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:18:15.926052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:18:15.926052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:18:15.926052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:18:15.926052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:18:15.926052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:18:15.926052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:18:15.926052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:15.926052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6OoKOsXfjNTp1mjsj6r1IgBAgQBzTLiQjJO0bR1TldRTpxWx6tSFZWanW3Gv02s-EY-9kVRC92iBnbzPS2ztWMdgardIrvDP60IsZABewH2eMK4dXX1f7Hpv6gsaQwPQ8jW613IMovFbfYZIhNfO_yD-aTLWmHXV3Hwct_s6HofR820 Aug 02 09:18:15.926052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:18:15.926052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:18:15.926052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:18:15.926052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:18:15.926052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:18:15.926052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:18:15.926052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:18:15.926052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:15.926052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:18:15.926052 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:18:15.929301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6fc6b07497a48eeb263b3a9b8aa7499"}]}] Aug 02 09:18:15.929301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:15.929301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:18:15.929301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:15.929301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:18:15.929301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:18:15.929301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:18:15.929301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: ad3a9141e9284bb5a096fb04d3e9d581 Aug 02 09:18:15.929301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:18:15.929301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: > Aug 02 09:18:15.929301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Instance 0cc9a7eb-eb1a-4b92-a548-da35114c2912 could not be found. Aug 02 09:18:15.929301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': '0cc9a7eb-eb1a-4b92-a548-da35114c2912'} Aug 02 09:18:15.930820 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:15.930820 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:15.930820 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:15.930820 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:15.930820 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:15.930820 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:15.930820 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:15.930820 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:15.930820 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:15.930820 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:15.930820 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cc9a7eb-eb1a-4b92-a548-da35114c2912 could not be found. Aug 02 09:18:15.930820 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:15.930820 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:15.930820 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:15.930820 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:15.930820 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:15.930820 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:15.930820 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:15.930820 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:15.930820 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:15.938184 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:15.938184 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:18:15.938184 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:18:15.938184 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:15.938184 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:15.938184 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:15.938184 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:15.938184 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cc9a7eb-eb1a-4b92-a548-da35114c2912 could not be found. Aug 02 09:18:15.938184 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:15.938184 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:15.938184 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:15.938184 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:15.938184 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:15.938184 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:15.938184 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:15.938184 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:15.938184 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cc9a7eb-eb1a-4b92-a548-da35114c2912 could not be found. Aug 02 09:18:15.938184 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:15.940727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-5001ae87-44d9-40e3-8400-12aeadc57085 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Returning 404 to user: Instance 0cc9a7eb-eb1a-4b92-a548-da35114c2912 could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:15.940727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-5001ae87-44d9-40e3-8400-12aeadc57085 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912" status: 404 len: 111 microversion: 2.1 time: 0.084618 Aug 02 09:18:15.940727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 442/860] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:15 2022] GET /compute/v2.1/servers/0cc9a7eb-eb1a-4b92-a548-da35114c2912 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:18:15.941119 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-95c8453c-6f1d-4313-b3ae-ee80b70a959c tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:15.941119 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-95c8453c-6f1d-4313-b3ae-ee80b70a959c tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:15.961262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-95c8453c-6f1d-4313-b3ae-ee80b70a959c tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:15.962804 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-95c8453c-6f1d-4313-b3ae-ee80b70a959c tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:15.964241 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-95c8453c-6f1d-4313-b3ae-ee80b70a959c tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:15.965189 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-95c8453c-6f1d-4313-b3ae-ee80b70a959c tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:16.193145 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-0a9adaa4-e5ca-412b-b91e-0649c4db28c7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:16.193999 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-0a9adaa4-e5ca-412b-b91e-0649c4db28c7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:16.204512 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0a9adaa4-e5ca-412b-b91e-0649c4db28c7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:16.210072 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0a9adaa4-e5ca-412b-b91e-0649c4db28c7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:16.216472 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0a9adaa4-e5ca-412b-b91e-0649c4db28c7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:16.216472 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0a9adaa4-e5ca-412b-b91e-0649c4db28c7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:16.456302 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-95c8453c-6f1d-4313-b3ae-ee80b70a959c tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:16.469683 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-95c8453c-6f1d-4313-b3ae-ee80b70a959c tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1267 microversion: 2.1 time: 0.538084 Aug 02 09:18:16.470559 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 419/861] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:15 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1267 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:16.639584 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-0a9adaa4-e5ca-412b-b91e-0649c4db28c7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:16.652376 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-ccd4ea5e-ee0c-4019-a423-01febcaf75ff tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:16.653145 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-ccd4ea5e-ee0c-4019-a423-01febcaf75ff tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:16.673140 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ccd4ea5e-ee0c-4019-a423-01febcaf75ff tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:16.674069 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ccd4ea5e-ee0c-4019-a423-01febcaf75ff tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:16.675337 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ccd4ea5e-ee0c-4019-a423-01febcaf75ff tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:16.676690 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-0a9adaa4-e5ca-412b-b91e-0649c4db28c7 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1567 microversion: 2.1 time: 0.481523 Aug 02 09:18:16.677690 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 443/862] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:16 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1567 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:16.679093 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ccd4ea5e-ee0c-4019-a423-01febcaf75ff tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:16.861443 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-ccd4ea5e-ee0c-4019-a423-01febcaf75ff tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:16.870853 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-ccd4ea5e-ee0c-4019-a423-01febcaf75ff tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be" status: 200 len: 1671 microversion: 2.1 time: 0.223324 Aug 02 09:18:16.871485 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 420/863] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:16 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be => generated 1671 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:17.463090 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4d8f9399-c906-4d38-b31e-ba4da9f18fb6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:17.463749 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-4d8f9399-c906-4d38-b31e-ba4da9f18fb6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:17.471426 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4d8f9399-c906-4d38-b31e-ba4da9f18fb6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:17.471867 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4d8f9399-c906-4d38-b31e-ba4da9f18fb6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:17.472687 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4d8f9399-c906-4d38-b31e-ba4da9f18fb6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:17.473330 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4d8f9399-c906-4d38-b31e-ba4da9f18fb6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:17.489931 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-4d8f9399-c906-4d38-b31e-ba4da9f18fb6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] HTTP exception thrown: Instance f9660960-566d-48c4-b5a7-413789e0e2c7 could not be found. Aug 02 09:18:17.492208 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4d8f9399-c906-4d38-b31e-ba4da9f18fb6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Request method failure captured: Aug 02 09:18:17.492208 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: DELETE /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 HTTP/1.1 Aug 02 09:18:17.492208 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:18:17.492208 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:18:17.492208 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:18:17.492208 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:18:17.492208 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:18:17.492208 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:18:17.492208 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:18:17.492208 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:17.492208 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6OoKOsXfjNTp1mjsj6r1IgBAgQBzTLiQjJO0bR1TldRTpxWx6tSFZWanW3Gv02s-EY-9kVRC92iBnbzPS2ztWMdgardIrvDP60IsZABewH2eMK4dXX1f7Hpv6gsaQwPQ8jW613IMovFbfYZIhNfO_yD-aTLWmHXV3Hwct_s6HofR820 Aug 02 09:18:17.492208 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:18:17.492208 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:18:17.492208 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:18:17.492208 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:18:17.492208 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:18:17.492208 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:18:17.492208 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:18:17.492208 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:17.492208 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:18:17.492208 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:18:17.494113 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6fc6b07497a48eeb263b3a9b8aa7499"}]}] Aug 02 09:18:17.494113 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:17.494113 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:18:17.494113 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:17.494113 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:18:17.494113 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:18:17.494113 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:18:17.494113 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: ad3a9141e9284bb5a096fb04d3e9d581 Aug 02 09:18:17.494113 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:18:17.494113 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: > Aug 02 09:18:17.494113 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Instance f9660960-566d-48c4-b5a7-413789e0e2c7 could not be found. Aug 02 09:18:17.494113 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': 'f9660960-566d-48c4-b5a7-413789e0e2c7'} Aug 02 09:18:17.495309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:17.495309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:17.495309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:17.495309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:17.495309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:17.495309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:17.495309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:17.495309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:17.495309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:17.495309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:17.495309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9660960-566d-48c4-b5a7-413789e0e2c7 could not be found. Aug 02 09:18:17.495309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:17.495309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:17.495309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:17.495309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:17.495309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:17.495309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:17.495309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:17.495309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:17.495309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:17.496945 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:17.496945 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:18:17.496945 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:18:17.496945 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:18:17.496945 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:18:17.496945 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:17.496945 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:17.496945 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:17.496945 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:17.496945 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9660960-566d-48c4-b5a7-413789e0e2c7 could not be found. Aug 02 09:18:17.496945 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:17.496945 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:17.496945 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:17.496945 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:17.496945 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:17.496945 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:17.496945 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:17.496945 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:17.496945 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9660960-566d-48c4-b5a7-413789e0e2c7 could not be found. Aug 02 09:18:17.496945 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:17.498749 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4d8f9399-c906-4d38-b31e-ba4da9f18fb6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Returning 404 to user: Instance f9660960-566d-48c4-b5a7-413789e0e2c7 could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:17.498749 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-4d8f9399-c906-4d38-b31e-ba4da9f18fb6 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 404 len: 111 microversion: 2.1 time: 0.035109 Aug 02 09:18:17.498749 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 444/864] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:18:17 2022] DELETE /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:18:17.503285 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-52d0cb9f-21e3-4e2a-ba24-96e487021208 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:17.504003 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-0a906bbe-3b13-4506-ba8d-93fcd27acbfa tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:17.504579 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-52d0cb9f-21e3-4e2a-ba24-96e487021208 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] [instance: f9660960-566d-48c4-b5a7-413789e0e2c7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:17.505910 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-0a906bbe-3b13-4506-ba8d-93fcd27acbfa tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:17.512144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-52d0cb9f-21e3-4e2a-ba24-96e487021208 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:17.512950 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-52d0cb9f-21e3-4e2a-ba24-96e487021208 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:17.513921 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-52d0cb9f-21e3-4e2a-ba24-96e487021208 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:17.514621 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-52d0cb9f-21e3-4e2a-ba24-96e487021208 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:17.526730 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0a906bbe-3b13-4506-ba8d-93fcd27acbfa tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:17.527420 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0a906bbe-3b13-4506-ba8d-93fcd27acbfa tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:17.529605 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0a906bbe-3b13-4506-ba8d-93fcd27acbfa tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:17.530802 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0a906bbe-3b13-4506-ba8d-93fcd27acbfa tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:17.533649 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-52d0cb9f-21e3-4e2a-ba24-96e487021208 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] HTTP exception thrown: Instance f9660960-566d-48c4-b5a7-413789e0e2c7 could not be found. Aug 02 09:18:17.535379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-52d0cb9f-21e3-4e2a-ba24-96e487021208 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Request method failure captured: Aug 02 09:18:17.535379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 HTTP/1.1 Aug 02 09:18:17.535379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:18:17.535379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:18:17.535379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:18:17.535379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:18:17.535379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:18:17.535379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:18:17.535379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:18:17.535379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:17.535379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6OoKOsXfjNTp1mjsj6r1IgBAgQBzTLiQjJO0bR1TldRTpxWx6tSFZWanW3Gv02s-EY-9kVRC92iBnbzPS2ztWMdgardIrvDP60IsZABewH2eMK4dXX1f7Hpv6gsaQwPQ8jW613IMovFbfYZIhNfO_yD-aTLWmHXV3Hwct_s6HofR820 Aug 02 09:18:17.535379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:18:17.535379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:18:17.535379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:18:17.535379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:18:17.535379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:18:17.535379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:18:17.535379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:18:17.535379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:17.535379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:18:17.535379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:18:17.540202 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/b6fc6b07497a48eeb263b3a9b8aa7499"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_b6fc6b07497a48eeb263b3a9b8aa7499"}]}] Aug 02 09:18:17.540202 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:17.540202 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: b6fc6b07497a48eeb263b3a9b8aa7499 Aug 02 09:18:17.540202 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1281401753 Aug 02 09:18:17.540202 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:18:17.540202 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:18:17.540202 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:18:17.540202 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: ad3a9141e9284bb5a096fb04d3e9d581 Aug 02 09:18:17.540202 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-AttachVolumeNegativeTest-1281401753-project Aug 02 09:18:17.540202 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: > Aug 02 09:18:17.540202 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Instance f9660960-566d-48c4-b5a7-413789e0e2c7 could not be found. Aug 02 09:18:17.540202 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': 'f9660960-566d-48c4-b5a7-413789e0e2c7'} Aug 02 09:18:17.541151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:17.541151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:17.541151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:17.541151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:17.541151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:17.541151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:17.541151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:17.541151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:17.541151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:17.541151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:17.541151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9660960-566d-48c4-b5a7-413789e0e2c7 could not be found. Aug 02 09:18:17.541151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:17.541151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:17.541151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:17.541151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:17.541151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:17.541151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:17.541151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:17.541151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:17.541151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:17.543201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:17.543201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:18:17.543201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:18:17.543201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:17.543201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:17.543201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:17.543201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:17.543201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9660960-566d-48c4-b5a7-413789e0e2c7 could not be found. Aug 02 09:18:17.543201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:17.543201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:17.543201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:17.543201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:17.543201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:17.543201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:17.543201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:17.543201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:17.543201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9660960-566d-48c4-b5a7-413789e0e2c7 could not be found. Aug 02 09:18:17.543201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:17.544860 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-52d0cb9f-21e3-4e2a-ba24-96e487021208 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] Returning 404 to user: Instance f9660960-566d-48c4-b5a7-413789e0e2c7 could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:17.544860 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-52d0cb9f-21e3-4e2a-ba24-96e487021208 tempest-AttachVolumeNegativeTest-1281401753 tempest-AttachVolumeNegativeTest-1281401753-project] 10.222.0.20 "GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7" status: 404 len: 111 microversion: 2.1 time: 0.038129 Aug 02 09:18:17.544860 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 445/865] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:17 2022] GET /compute/v2.1/servers/f9660960-566d-48c4-b5a7-413789e0e2c7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:18:17.721702 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-cd82e2ed-6ff5-4a5f-8428-2b75fba0fea3 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:17.722280 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-cd82e2ed-6ff5-4a5f-8428-2b75fba0fea3 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:17.729824 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cd82e2ed-6ff5-4a5f-8428-2b75fba0fea3 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:17.730276 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cd82e2ed-6ff5-4a5f-8428-2b75fba0fea3 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:17.731070 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cd82e2ed-6ff5-4a5f-8428-2b75fba0fea3 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:17.731507 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cd82e2ed-6ff5-4a5f-8428-2b75fba0fea3 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:18.317923 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-0a906bbe-3b13-4506-ba8d-93fcd27acbfa tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:18.340052 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-0a906bbe-3b13-4506-ba8d-93fcd27acbfa tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1267 microversion: 2.1 time: 0.849082 Aug 02 09:18:18.341099 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 421/866] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:17 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1267 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:18.365020 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-04931ec7-d7ba-4249-8942-0be87d90e42c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:18.372725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-04931ec7-d7ba-4249-8942-0be87d90e42c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:18.376356 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=4,nova_api:DELETE=2 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:18.381205 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-04931ec7-d7ba-4249-8942-0be87d90e42c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:18.382535 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-04931ec7-d7ba-4249-8942-0be87d90e42c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:18.383999 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-04931ec7-d7ba-4249-8942-0be87d90e42c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:18.383999 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-04931ec7-d7ba-4249-8942-0be87d90e42c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:18.412645 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-cd82e2ed-6ff5-4a5f-8428-2b75fba0fea3 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:18.416601 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:18.433917 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-cd82e2ed-6ff5-4a5f-8428-2b75fba0fea3 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1567 microversion: 2.1 time: 0.715852 Aug 02 09:18:18.435276 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 446/867] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:17 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1567 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:18.443225 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ef848150-8eb6-4feb-b411-27508c4494ef tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-634457914", "imageRef": "7a52f4c5-c531-494a-b375-4f6dce3abbc2", "flavorRef": "452", "networks": [{"uuid": "a3629eac-1176-4926-9ce9-18b868d39937"}]}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:18.535962 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.network.neutron [None req-ef848150-8eb6-4feb-b411-27508c4494ef tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] validate_networks() for [('a3629eac-1176-4926-9ce9-18b868d39937', None, None, None, None, None)] {{(pid=118525) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:18:19.012065 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-04931ec7-d7ba-4249-8942-0be87d90e42c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:19.023005 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-04931ec7-d7ba-4249-8942-0be87d90e42c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be" status: 200 len: 1671 microversion: 2.1 time: 0.680678 Aug 02 09:18:19.024938 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 422/868] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:18 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be => generated 1671 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:19.035763 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-b113a98b-d35d-4e5c-924c-98e2805f6fa2 req-61c29edc-dbb3-4349-8fb2-ea7ac2784f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c36b6524-980c-4f56-b1ad-e71536c08577", "name": "network-vif-deleted", "tag": "541f0637-de44-45f3-b1dd-7b7924d55993"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:19.057868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-b113a98b-d35d-4e5c-924c-98e2805f6fa2 req-61c29edc-dbb3-4349-8fb2-ea7ac2784f75 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:19.058324 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-b113a98b-d35d-4e5c-924c-98e2805f6fa2 req-61c29edc-dbb3-4349-8fb2-ea7ac2784f75 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:19.093495 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-b113a98b-d35d-4e5c-924c-98e2805f6fa2 req-61c29edc-dbb3-4349-8fb2-ea7ac2784f75 service nova] Creating event network-vif-deleted:541f0637-de44-45f3-b1dd-7b7924d55993 for instance c36b6524-980c-4f56-b1ad-e71536c08577 on hv-cinder-84599 Aug 02 09:18:19.102073 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-b113a98b-d35d-4e5c-924c-98e2805f6fa2 req-61c29edc-dbb3-4349-8fb2-ea7ac2784f75 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073075 Aug 02 09:18:19.103418 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 423/869] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:19.381088 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-dbc270f3-e7be-4b11-9b24-233c3893fef5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:19.382395 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-dbc270f3-e7be-4b11-9b24-233c3893fef5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:19.394492 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-dbc270f3-e7be-4b11-9b24-233c3893fef5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:19.395960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-dbc270f3-e7be-4b11-9b24-233c3893fef5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:19.398622 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-dbc270f3-e7be-4b11-9b24-233c3893fef5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:19.401567 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-dbc270f3-e7be-4b11-9b24-233c3893fef5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:19.831005 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-dbc270f3-e7be-4b11-9b24-233c3893fef5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:19.849796 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-dbc270f3-e7be-4b11-9b24-233c3893fef5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1267 microversion: 2.1 time: 0.467360 Aug 02 09:18:19.850519 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 424/870] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:19 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1267 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:19.856006 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-6abe7e87-1416-412e-b302-47dd505cb39b tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:19.856653 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-6abe7e87-1416-412e-b302-47dd505cb39b tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:19.873035 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6abe7e87-1416-412e-b302-47dd505cb39b tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:19.875601 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6abe7e87-1416-412e-b302-47dd505cb39b tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:19.877223 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6abe7e87-1416-412e-b302-47dd505cb39b tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:19.877930 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6abe7e87-1416-412e-b302-47dd505cb39b tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:19.908629 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-ef848150-8eb6-4feb-b411-27508c4494ef tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Flavor limits 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:18:19.910598 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-ef848150-8eb6-4feb-b411-27508c4494ef tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Image limits 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:18:19.913613 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-ef848150-8eb6-4feb-b411-27508c4494ef tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Flavor pref 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:18:19.914828 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-ef848150-8eb6-4feb-b411-27508c4494ef tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Image pref 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:18:19.915542 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-ef848150-8eb6-4feb-b411-27508c4494ef tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:18:19.929885 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ef848150-8eb6-4feb-b411-27508c4494ef tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:19.931460 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ef848150-8eb6-4feb-b411-27508c4494ef tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:19.932869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ef848150-8eb6-4feb-b411-27508c4494ef tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:19.933370 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ef848150-8eb6-4feb-b411-27508c4494ef tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:19.976305 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-ef848150-8eb6-4feb-b411-27508c4494ef tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Getting quotas for project f15f389a69d249adaa55b25d60e54ab0. Resources: {'cores', 'ram', 'instances'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:18:19.983479 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-ef848150-8eb6-4feb-b411-27508c4494ef tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Getting quotas for user 6cd2f7ae47fd42929ccfaed668c5a55f and project f15f389a69d249adaa55b25d60e54ab0. Resources: {'cores', 'ram', 'instances'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:18:20.037311 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ef848150-8eb6-4feb-b411-27508c4494ef tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Going to run 1 instances... {{(pid=118525) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:18:20.046488 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ef848150-8eb6-4feb-b411-27508c4494ef tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: ade33310-ad5b-4c56-98b9-2754b809d6d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7a52f4c5-c531-494a-b375-4f6dce3abbc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118525) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:18:20.108680 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-6abe7e87-1416-412e-b302-47dd505cb39b tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:20.122505 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-6abe7e87-1416-412e-b302-47dd505cb39b tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1381 microversion: 2.1 time: 0.270331 Aug 02 09:18:20.123263 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 425/871] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:19 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1381 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:20.146269 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-24cd2cb9-fd05-4e90-b241-2da288cf734f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:20.146887 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-24cd2cb9-fd05-4e90-b241-2da288cf734f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:20.157088 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-24cd2cb9-fd05-4e90-b241-2da288cf734f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:20.157856 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-24cd2cb9-fd05-4e90-b241-2da288cf734f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:20.159146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-24cd2cb9-fd05-4e90-b241-2da288cf734f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:20.159718 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-24cd2cb9-fd05-4e90-b241-2da288cf734f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:20.271995 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-24cd2cb9-fd05-4e90-b241-2da288cf734f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:20.288085 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-24cd2cb9-fd05-4e90-b241-2da288cf734f tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be" status: 200 len: 1603 microversion: 2.1 time: 0.145470 Aug 02 09:18:20.291852 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 426/872] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:20 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be => generated 1603 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:20.307969 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-13aff308-db0e-4790-a6bb-d9b3cd4feca0 req-bbd89362-0b3b-48b2-9dcf-57548ccfbbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71fb0604-8809-49fd-9b86-e8441c47c2be", "name": "network-vif-unplugged", "status": "completed", "tag": "d6fbfff8-482d-4758-81e9-d3d768e635e3"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:20.342073 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-13aff308-db0e-4790-a6bb-d9b3cd4feca0 req-bbd89362-0b3b-48b2-9dcf-57548ccfbbd3 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:20.343264 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ef848150-8eb6-4feb-b411-27508c4494ef tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.906164 Aug 02 09:18:20.343916 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 447/873] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 2 09:18:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:18:20.351833 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-13aff308-db0e-4790-a6bb-d9b3cd4feca0 req-bbd89362-0b3b-48b2-9dcf-57548ccfbbd3 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:20.375278 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-71aa5234-080b-4c2a-9bfa-c7e1e56f1f22 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:20.384684 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-71aa5234-080b-4c2a-9bfa-c7e1e56f1f22 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: ade33310-ad5b-4c56-98b9-2754b809d6d7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:20.399980 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-13aff308-db0e-4790-a6bb-d9b3cd4feca0 req-bbd89362-0b3b-48b2-9dcf-57548ccfbbd3 service nova] Creating event network-vif-unplugged:d6fbfff8-482d-4758-81e9-d3d768e635e3 for instance 71fb0604-8809-49fd-9b86-e8441c47c2be on hv-cinder-84599 Aug 02 09:18:20.432617 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-13aff308-db0e-4790-a6bb-d9b3cd4feca0 req-bbd89362-0b3b-48b2-9dcf-57548ccfbbd3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.136594 Aug 02 09:18:20.437989 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 427/874] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:18:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:20.697028 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-71aa5234-080b-4c2a-9bfa-c7e1e56f1f22 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:20.717737 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-71aa5234-080b-4c2a-9bfa-c7e1e56f1f22 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7" status: 200 len: 1213 microversion: 2.1 time: 0.364287 Aug 02 09:18:20.721273 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 448/875] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:20 2022] GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7 => generated 1213 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:20.873326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c38e7290-d365-4ce1-a15e-9b212c0cb41a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:20.874471 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-c38e7290-d365-4ce1-a15e-9b212c0cb41a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:20.885632 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c38e7290-d365-4ce1-a15e-9b212c0cb41a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:20.891450 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c38e7290-d365-4ce1-a15e-9b212c0cb41a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:20.892808 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c38e7290-d365-4ce1-a15e-9b212c0cb41a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:20.894691 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c38e7290-d365-4ce1-a15e-9b212c0cb41a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:21.144500 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-1ef069e2-db7a-4110-8ae1-3d82707648dd tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:21.145945 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-1ef069e2-db7a-4110-8ae1-3d82707648dd tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:21.160341 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1ef069e2-db7a-4110-8ae1-3d82707648dd tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:21.161689 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1ef069e2-db7a-4110-8ae1-3d82707648dd tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:21.163559 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1ef069e2-db7a-4110-8ae1-3d82707648dd tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:21.167400 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1ef069e2-db7a-4110-8ae1-3d82707648dd tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:21.234013 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1ef069e2-db7a-4110-8ae1-3d82707648dd tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:21.234540 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1ef069e2-db7a-4110-8ae1-3d82707648dd tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:21.235253 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.objects.instance [None req-1ef069e2-db7a-4110-8ae1-3d82707648dd tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lazy-loading 'fault' on Instance uuid c36b6524-980c-4f56-b1ad-e71536c08577 {{(pid=118525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:18:21.316114 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-1ef069e2-db7a-4110-8ae1-3d82707648dd tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '75559881115047eeb72554769404ed0a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebb47864b5694d2e85b1d90eb2c809bc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:21.331115 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-1ef069e2-db7a-4110-8ae1-3d82707648dd tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 200 len: 1340 microversion: 2.1 time: 0.190328 Aug 02 09:18:21.347400 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 449/876] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:21 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 1340 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:21.353731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-e34cbd30-b1e4-44cc-bdfd-18e40c2ad511 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:21.354183 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-e34cbd30-b1e4-44cc-bdfd-18e40c2ad511 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:21.390441 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e34cbd30-b1e4-44cc-bdfd-18e40c2ad511 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:21.390889 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e34cbd30-b1e4-44cc-bdfd-18e40c2ad511 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:21.393777 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e34cbd30-b1e4-44cc-bdfd-18e40c2ad511 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:21.394493 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e34cbd30-b1e4-44cc-bdfd-18e40c2ad511 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:21.542899 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-c38e7290-d365-4ce1-a15e-9b212c0cb41a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:21.556182 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-c38e7290-d365-4ce1-a15e-9b212c0cb41a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1267 microversion: 2.1 time: 0.688047 Aug 02 09:18:21.556894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-e34cbd30-b1e4-44cc-bdfd-18e40c2ad511 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:21.572002 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-e34cbd30-b1e4-44cc-bdfd-18e40c2ad511 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be" status: 200 len: 1603 microversion: 2.1 time: 0.217671 Aug 02 09:18:21.573107 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 428/878] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:20 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1267 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:21.573485 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 450/878] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:21 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be => generated 1603 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:21.580178 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-16450bb3-a34f-4a6e-9bb8-a183837dbf5c req-d6972eb2-f382-4a4b-93b7-efaa072c6fef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71fb0604-8809-49fd-9b86-e8441c47c2be", "name": "network-vif-deleted", "tag": "d6fbfff8-482d-4758-81e9-d3d768e635e3"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:21.600110 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-16450bb3-a34f-4a6e-9bb8-a183837dbf5c req-d6972eb2-f382-4a4b-93b7-efaa072c6fef service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:21.600606 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-16450bb3-a34f-4a6e-9bb8-a183837dbf5c req-d6972eb2-f382-4a4b-93b7-efaa072c6fef service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:21.619682 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-16450bb3-a34f-4a6e-9bb8-a183837dbf5c req-d6972eb2-f382-4a4b-93b7-efaa072c6fef service nova] Creating event network-vif-deleted:d6fbfff8-482d-4758-81e9-d3d768e635e3 for instance 71fb0604-8809-49fd-9b86-e8441c47c2be on hv-cinder-84599 Aug 02 09:18:21.636390 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-16450bb3-a34f-4a6e-9bb8-a183837dbf5c req-d6972eb2-f382-4a4b-93b7-efaa072c6fef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060707 Aug 02 09:18:21.637219 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 429/879] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:21.753433 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-9292e319-475f-4b22-8235-8b622f9efe33 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:21.754330 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-9292e319-475f-4b22-8235-8b622f9efe33 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: ade33310-ad5b-4c56-98b9-2754b809d6d7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:21.832636 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-9292e319-475f-4b22-8235-8b622f9efe33 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:21.870557 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-9292e319-475f-4b22-8235-8b622f9efe33 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7" status: 200 len: 1213 microversion: 2.1 time: 0.110198 Aug 02 09:18:21.870557 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 451/880] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:21 2022] GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7 => generated 1213 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:22.354856 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-45181bc9-70b0-4b2f-a2ba-2d431c96f93a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:22.358194 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-45181bc9-70b0-4b2f-a2ba-2d431c96f93a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] [instance: c36b6524-980c-4f56-b1ad-e71536c08577] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:22.362301 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-45181bc9-70b0-4b2f-a2ba-2d431c96f93a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:22.362860 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-45181bc9-70b0-4b2f-a2ba-2d431c96f93a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:22.363830 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-45181bc9-70b0-4b2f-a2ba-2d431c96f93a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:22.364126 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-45181bc9-70b0-4b2f-a2ba-2d431c96f93a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:22.380050 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-45181bc9-70b0-4b2f-a2ba-2d431c96f93a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] HTTP exception thrown: Instance c36b6524-980c-4f56-b1ad-e71536c08577 could not be found. Aug 02 09:18:22.382463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-45181bc9-70b0-4b2f-a2ba-2d431c96f93a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Request method failure captured: Aug 02 09:18:22.382463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 HTTP/1.1 Aug 02 09:18:22.382463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:18:22.382463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:18:22.382463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:18:22.382463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:18:22.382463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:18:22.382463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:18:22.382463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:18:22.382463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:22.382463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OqECAR0bzhaL7_KNNYumJl6gNZgKiqnL-jiMkmEyFZm180wzmjSQCH5O3kHZ595KJ1vgKhEYvs24BhB9gDl7IR5Vf18PKtPvH-wn8foyuNTwcCuRXUodZVgMYPlm-R-5cL9WFZGtG4c-HHe7aNKg8uCTVHwo45NaZGalZSbHsBMExs Aug 02 09:18:22.382463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:18:22.382463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:18:22.382463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:18:22.382463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:18:22.382463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:18:22.382463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:18:22.382463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: ebb47864b5694d2e85b1d90eb2c809bc Aug 02 09:18:22.382463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-TestShelveInstance-1920277495 Aug 02 09:18:22.382463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:18:22.382463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:18:22.388447 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebb47864b5694d2e85b1d90eb2c809bc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ebb47864b5694d2e85b1d90eb2c809bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebb47864b5694d2e85b1d90eb2c809bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ebb47864b5694d2e85b1d90eb2c809bc"}]}] Aug 02 09:18:22.388447 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-TestShelveInstance-1920277495 Aug 02 09:18:22.388447 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: ebb47864b5694d2e85b1d90eb2c809bc Aug 02 09:18:22.388447 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-TestShelveInstance-1920277495 Aug 02 09:18:22.388447 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-TestShelveInstance-1920277495-project Aug 02 09:18:22.388447 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:18:22.388447 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:18:22.388447 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: 75559881115047eeb72554769404ed0a Aug 02 09:18:22.388447 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-TestShelveInstance-1920277495-project Aug 02 09:18:22.388447 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:18:22.388447 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Instance c36b6524-980c-4f56-b1ad-e71536c08577 could not be found. Aug 02 09:18:22.388447 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'id': 'c36b6524-980c-4f56-b1ad-e71536c08577'} Aug 02 09:18:22.389472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:22.389472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:22.389472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:22.389472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:22.389472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:22.389472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:22.389472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:22.389472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:22.389472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:22.389472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:22.389472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c36b6524-980c-4f56-b1ad-e71536c08577 could not be found. Aug 02 09:18:22.389472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:22.389472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:22.389472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:22.389472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:22.389472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:22.389472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:22.389472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:22.389472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:22.389472 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:22.390843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:22.390843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:18:22.390843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:18:22.390843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:22.390843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:22.390843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:22.390843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:22.390843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c36b6524-980c-4f56-b1ad-e71536c08577 could not be found. Aug 02 09:18:22.390843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:22.390843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:22.390843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:22.390843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:22.390843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:22.390843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:22.390843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:22.390843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:22.390843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c36b6524-980c-4f56-b1ad-e71536c08577 could not be found. Aug 02 09:18:22.390843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:22.392074 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-45181bc9-70b0-4b2f-a2ba-2d431c96f93a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Returning 404 to user: Instance c36b6524-980c-4f56-b1ad-e71536c08577 could not be found. {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:22.392074 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-45181bc9-70b0-4b2f-a2ba-2d431c96f93a tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577" status: 404 len: 111 microversion: 2.1 time: 0.034434 Aug 02 09:18:22.392074 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 430/881] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:22 2022] GET /compute/v2.1/servers/c36b6524-980c-4f56-b1ad-e71536c08577 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:18:22.490503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-4aab2c7f-e2fa-428f-8325-93e89f31887f req-b008ce8c-fe0b-4a3f-b119-593f384882ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c", "name": "network-vif-plugged", "status": "completed", "tag": "ec5c5fb4-4216-49ff-9a57-3adc12d6b9f9"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:22.504775 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-4aab2c7f-e2fa-428f-8325-93e89f31887f req-b008ce8c-fe0b-4a3f-b119-593f384882ed service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:22.507492 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-4aab2c7f-e2fa-428f-8325-93e89f31887f req-b008ce8c-fe0b-4a3f-b119-593f384882ed service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:22.532294 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-4aab2c7f-e2fa-428f-8325-93e89f31887f req-b008ce8c-fe0b-4a3f-b119-593f384882ed service nova] Creating event network-vif-plugged:ec5c5fb4-4216-49ff-9a57-3adc12d6b9f9 for instance 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c on hv-cinder-84599 Aug 02 09:18:22.555909 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-4aab2c7f-e2fa-428f-8325-93e89f31887f req-b008ce8c-fe0b-4a3f-b119-593f384882ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076093 Aug 02 09:18:22.559113 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 452/882] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:22.585473 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-36a6a699-4fdc-4710-8787-96bf5d49bc30 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:22.586123 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-36a6a699-4fdc-4710-8787-96bf5d49bc30 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:22.598119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4d67d76f-b2ee-4ab9-b92a-e7f5410a1982 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:22.598883 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-4d67d76f-b2ee-4ab9-b92a-e7f5410a1982 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:22.612107 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-36a6a699-4fdc-4710-8787-96bf5d49bc30 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:22.625125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-36a6a699-4fdc-4710-8787-96bf5d49bc30 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:22.630979 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-36a6a699-4fdc-4710-8787-96bf5d49bc30 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:22.632929 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-36a6a699-4fdc-4710-8787-96bf5d49bc30 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:22.645013 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4d67d76f-b2ee-4ab9-b92a-e7f5410a1982 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:22.649129 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4d67d76f-b2ee-4ab9-b92a-e7f5410a1982 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:22.656516 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4d67d76f-b2ee-4ab9-b92a-e7f5410a1982 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:22.657681 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4d67d76f-b2ee-4ab9-b92a-e7f5410a1982 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:22.751412 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4d67d76f-b2ee-4ab9-b92a-e7f5410a1982 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:22.752436 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4d67d76f-b2ee-4ab9-b92a-e7f5410a1982 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:22.753147 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.objects.instance [None req-4d67d76f-b2ee-4ab9-b92a-e7f5410a1982 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lazy-loading 'fault' on Instance uuid 71fb0604-8809-49fd-9b86-e8441c47c2be {{(pid=118525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:18:22.935089 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-4d67d76f-b2ee-4ab9-b92a-e7f5410a1982 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3bccd348dd13473e82ca33c42b840383', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '696f75fb6c494cfab9deb3d36c3ad599', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:22.950856 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-4d67d76f-b2ee-4ab9-b92a-e7f5410a1982 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be" status: 200 len: 1327 microversion: 2.1 time: 0.357062 Aug 02 09:18:22.955293 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 453/883] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:22 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be => generated 1327 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:22.989686 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-93dcecbf-4d3c-4b62-82ae-91e7bd94bb14 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:22.994071 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-93dcecbf-4d3c-4b62-82ae-91e7bd94bb14 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: ade33310-ad5b-4c56-98b9-2754b809d6d7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:23.010085 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-93dcecbf-4d3c-4b62-82ae-91e7bd94bb14 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:23.029896 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-93dcecbf-4d3c-4b62-82ae-91e7bd94bb14 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:23.033244 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-93dcecbf-4d3c-4b62-82ae-91e7bd94bb14 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:23.033606 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-93dcecbf-4d3c-4b62-82ae-91e7bd94bb14 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:23.256303 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-93dcecbf-4d3c-4b62-82ae-91e7bd94bb14 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:23.278608 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-93dcecbf-4d3c-4b62-82ae-91e7bd94bb14 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7" status: 200 len: 1209 microversion: 2.1 time: 0.312635 Aug 02 09:18:23.290141 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 454/884] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:22 2022] GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7 => generated 1209 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:23.302024 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-cae5c5ef-7b33-4dbb-a615-78afee16cf73 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] Calling method '.version_select at 0x7ffb9a9434c0>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:23.433605 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-cae5c5ef-7b33-4dbb-a615-78afee16cf73 tempest-TestShelveInstance-1920277495 tempest-TestShelveInstance-1920277495-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-425466987" status: 202 len: 0 microversion: 2.1 time: 0.132846 Aug 02 09:18:23.436304 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 455/885] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 2 09:18:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-425466987 => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:18:23.508324 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-36a6a699-4fdc-4710-8787-96bf5d49bc30 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:23.518544 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-36a6a699-4fdc-4710-8787-96bf5d49bc30 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1267 microversion: 2.1 time: 0.937742 Aug 02 09:18:23.519551 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 431/886] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:22 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1267 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:24.015477 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-92455dc7-889e-4af2-a0c3-6e153d3ef3f1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:24.018869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-92455dc7-889e-4af2-a0c3-6e153d3ef3f1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:24.028118 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-92455dc7-889e-4af2-a0c3-6e153d3ef3f1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:24.030646 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-92455dc7-889e-4af2-a0c3-6e153d3ef3f1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:24.031764 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-92455dc7-889e-4af2-a0c3-6e153d3ef3f1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:24.032390 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-92455dc7-889e-4af2-a0c3-6e153d3ef3f1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:24.067502 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-92455dc7-889e-4af2-a0c3-6e153d3ef3f1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] HTTP exception thrown: Instance 71fb0604-8809-49fd-9b86-e8441c47c2be could not be found. Aug 02 09:18:24.080014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-92455dc7-889e-4af2-a0c3-6e153d3ef3f1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Request method failure captured: Aug 02 09:18:24.080014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be HTTP/1.1 Aug 02 09:18:24.080014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:18:24.080014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:18:24.080014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:18:24.080014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:18:24.080014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:18:24.080014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:18:24.080014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:18:24.080014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:24.080014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6OpsBR6h-Hh4LBg89etYcnHlHEfSnLo-qquyYn5hIv5GzaybSFvSkFeeQeiuO6eTSrHwoIsJQSkeHfU0Xu14EgDesftcfDgkuNBpFyG7LZ49WYHglfFft-eRdQuY3tvdcPoOuGiTV3AKukz4BkX7MM2qLdRCP_8VUArgzWtGq8k_Gyo Aug 02 09:18:24.080014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:18:24.080014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:18:24.080014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:18:24.080014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:18:24.080014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:18:24.080014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:18:24.080014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: 696f75fb6c494cfab9deb3d36c3ad599 Aug 02 09:18:24.080014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-AttachVolumeTestJSON-2016443108 Aug 02 09:18:24.080014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:18:24.080014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:18:24.081935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/696f75fb6c494cfab9deb3d36c3ad599"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/696f75fb6c494cfab9deb3d36c3ad599"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/696f75fb6c494cfab9deb3d36c3ad599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_696f75fb6c494cfab9deb3d36c3ad599"}]}] Aug 02 09:18:24.081935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-AttachVolumeTestJSON-2016443108 Aug 02 09:18:24.081935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: 696f75fb6c494cfab9deb3d36c3ad599 Aug 02 09:18:24.081935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2016443108 Aug 02 09:18:24.081935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-AttachVolumeTestJSON-2016443108-project Aug 02 09:18:24.081935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:18:24.081935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:18:24.081935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: 3bccd348dd13473e82ca33c42b840383 Aug 02 09:18:24.081935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-AttachVolumeTestJSON-2016443108-project Aug 02 09:18:24.081935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: > Aug 02 09:18:24.081935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Instance 71fb0604-8809-49fd-9b86-e8441c47c2be could not be found. Aug 02 09:18:24.081935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': '71fb0604-8809-49fd-9b86-e8441c47c2be'} Aug 02 09:18:24.087164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:24.087164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:24.087164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:24.087164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:24.087164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:24.087164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:24.087164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:24.087164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:24.087164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:24.087164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:24.087164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71fb0604-8809-49fd-9b86-e8441c47c2be could not be found. Aug 02 09:18:24.087164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:24.087164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:24.087164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:24.087164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:24.087164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:24.087164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:24.087164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:24.087164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:24.087164 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:24.088747 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:24.088747 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:18:24.088747 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:18:24.088747 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:24.088747 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:24.088747 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:24.088747 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:24.088747 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71fb0604-8809-49fd-9b86-e8441c47c2be could not be found. Aug 02 09:18:24.088747 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:24.088747 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:24.088747 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:24.088747 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:24.088747 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:24.088747 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:24.088747 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:24.088747 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:24.088747 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71fb0604-8809-49fd-9b86-e8441c47c2be could not be found. Aug 02 09:18:24.088747 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:24.090081 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-92455dc7-889e-4af2-a0c3-6e153d3ef3f1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Returning 404 to user: Instance 71fb0604-8809-49fd-9b86-e8441c47c2be could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:24.090081 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-92455dc7-889e-4af2-a0c3-6e153d3ef3f1 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be" status: 404 len: 111 microversion: 2.1 time: 0.088512 Aug 02 09:18:24.090081 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 456/887] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:23 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:18:24.091643 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-af591a36-e5c9-42a0-96fb-c64fc8e2048c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '.version_select at 0x7ffb9a9bc4c0>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:24.211342 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-af591a36-e5c9-42a0-96fb-c64fc8e2048c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-955082367" status: 202 len: 0 microversion: 2.1 time: 0.123509 Aug 02 09:18:24.212740 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 432/888] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Aug 2 09:18:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-955082367 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:18:24.316017 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-704c3424-2855-4532-813e-1c7856b9a425 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:24.316687 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-704c3424-2855-4532-813e-1c7856b9a425 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: ade33310-ad5b-4c56-98b9-2754b809d6d7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:24.333532 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-704c3424-2855-4532-813e-1c7856b9a425 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:24.333999 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-704c3424-2855-4532-813e-1c7856b9a425 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:24.334857 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-704c3424-2855-4532-813e-1c7856b9a425 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:24.341942 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-704c3424-2855-4532-813e-1c7856b9a425 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:24.457767 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-704c3424-2855-4532-813e-1c7856b9a425 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:24.476886 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-704c3424-2855-4532-813e-1c7856b9a425 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7" status: 200 len: 1265 microversion: 2.1 time: 0.166115 Aug 02 09:18:24.478708 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 457/889] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:24 2022] GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:24.556667 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-d79bea80-61e6-41c3-a278-bfa563846915 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:24.557552 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-d79bea80-61e6-41c3-a278-bfa563846915 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:24.569793 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d79bea80-61e6-41c3-a278-bfa563846915 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:24.570446 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d79bea80-61e6-41c3-a278-bfa563846915 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:24.571940 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d79bea80-61e6-41c3-a278-bfa563846915 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:24.573698 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d79bea80-61e6-41c3-a278-bfa563846915 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:24.844326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-d79bea80-61e6-41c3-a278-bfa563846915 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:24.854734 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-d79bea80-61e6-41c3-a278-bfa563846915 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1267 microversion: 2.1 time: 0.303190 Aug 02 09:18:24.855240 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 433/890] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:24 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1267 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:25.498924 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-5600164b-6aaf-4236-bc14-4cc50d269554 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:25.499680 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-5600164b-6aaf-4236-bc14-4cc50d269554 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: ade33310-ad5b-4c56-98b9-2754b809d6d7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:25.507148 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5600164b-6aaf-4236-bc14-4cc50d269554 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:25.507680 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5600164b-6aaf-4236-bc14-4cc50d269554 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:25.510393 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5600164b-6aaf-4236-bc14-4cc50d269554 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:25.512128 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5600164b-6aaf-4236-bc14-4cc50d269554 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:25.682276 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-5600164b-6aaf-4236-bc14-4cc50d269554 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:25.692503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-5600164b-6aaf-4236-bc14-4cc50d269554 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7" status: 200 len: 1283 microversion: 2.1 time: 0.198004 Aug 02 09:18:25.710858 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 458/891] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:25 2022] GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7 => generated 1283 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:25.877894 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-6021f0c8-af83-417c-92d5-7c993e40f8e8 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:25.879404 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-6021f0c8-af83-417c-92d5-7c993e40f8e8 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:25.887812 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6021f0c8-af83-417c-92d5-7c993e40f8e8 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:25.888594 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6021f0c8-af83-417c-92d5-7c993e40f8e8 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:25.889683 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6021f0c8-af83-417c-92d5-7c993e40f8e8 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:25.890234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6021f0c8-af83-417c-92d5-7c993e40f8e8 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:26.226914 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-266c8884-95b3-4e52-847b-b64f00a40c3f tempest-VolumesTestJSON-192509201 tempest-VolumesTestJSON-192509201-project] Calling method '.version_select at 0x7ffb9a9aae50>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:26.286908 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-266c8884-95b3-4e52-847b-b64f00a40c3f tempest-VolumesTestJSON-192509201 tempest-VolumesTestJSON-192509201-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/8f866cad-6194-41f1-9bef-27ef2b426782" status: 200 len: 351 microversion: 2.1 time: 0.066617 Aug 02 09:18:26.293177 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 459/892] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 2 09:18:26 2022] GET /compute/v2.1/os-volumes/8f866cad-6194-41f1-9bef-27ef2b426782 => generated 351 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:26.303814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-6021f0c8-af83-417c-92d5-7c993e40f8e8 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:26.307141 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:26.319270 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-6021f0c8-af83-417c-92d5-7c993e40f8e8 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1454 microversion: 2.1 time: 0.443595 Aug 02 09:18:26.326675 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 434/893] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:25 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1454 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:26.349055 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-1b878859-dccf-4182-ab39-b32f73c4c13e tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:26.351767 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-1b878859-dccf-4182-ab39-b32f73c4c13e tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:26.358807 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1b878859-dccf-4182-ab39-b32f73c4c13e tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:26.359631 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1b878859-dccf-4182-ab39-b32f73c4c13e tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:26.360426 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1b878859-dccf-4182-ab39-b32f73c4c13e tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:26.360873 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1b878859-dccf-4182-ab39-b32f73c4c13e tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:26.699223 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-1b878859-dccf-4182-ab39-b32f73c4c13e tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:26.707774 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-1b878859-dccf-4182-ab39-b32f73c4c13e tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1454 microversion: 2.1 time: 0.363283 Aug 02 09:18:26.708511 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 460/894] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:26 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1454 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:26.721157 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-5ad03336-3c20-4460-bc46-ec9f701e3ac4 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:26.721919 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-5ad03336-3c20-4460-bc46-ec9f701e3ac4 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: ade33310-ad5b-4c56-98b9-2754b809d6d7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:26.737576 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5ad03336-3c20-4460-bc46-ec9f701e3ac4 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:26.737576 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5ad03336-3c20-4460-bc46-ec9f701e3ac4 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:26.737576 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5ad03336-3c20-4460-bc46-ec9f701e3ac4 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:26.738053 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5ad03336-3c20-4460-bc46-ec9f701e3ac4 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:27.170122 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-5ad03336-3c20-4460-bc46-ec9f701e3ac4 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:27.184382 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-5ad03336-3c20-4460-bc46-ec9f701e3ac4 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7" status: 200 len: 1271 microversion: 2.1 time: 0.466444 Aug 02 09:18:27.186083 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 435/895] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:26 2022] GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7 => generated 1271 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:27.772841 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-bcdb2104-9de8-42f0-84af-ed19125d3d9d tempest-VolumesGetTestJSON-1838131553 tempest-VolumesGetTestJSON-1838131553-project] Action: 'create', calling method: .version_select at 0x7ffb9a9aaf70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-828346043", "metadata": {"Type": "work"}}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:28.221395 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-9c400344-26d5-4ce4-bf6d-b51a5e80d1bc tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:28.222649 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-9c400344-26d5-4ce4-bf6d-b51a5e80d1bc tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: ade33310-ad5b-4c56-98b9-2754b809d6d7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:28.234141 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9c400344-26d5-4ce4-bf6d-b51a5e80d1bc tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:28.235696 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9c400344-26d5-4ce4-bf6d-b51a5e80d1bc tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:28.235696 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9c400344-26d5-4ce4-bf6d-b51a5e80d1bc tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:28.236380 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9c400344-26d5-4ce4-bf6d-b51a5e80d1bc tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:28.648363 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-9c400344-26d5-4ce4-bf6d-b51a5e80d1bc tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:28.668517 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-9c400344-26d5-4ce4-bf6d-b51a5e80d1bc tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7" status: 200 len: 1313 microversion: 2.1 time: 0.460879 Aug 02 09:18:28.682451 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 436/896] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:28 2022] GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7 => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:28.682451 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-119d457d-eb67-45be-bb3a-4a1fb1bac8d2 tempest-VolumesTestJSON-192509201 tempest-VolumesTestJSON-192509201-project] Calling method '.version_select at 0x7ffb9aa3c8b0>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:28.747405 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-119d457d-eb67-45be-bb3a-4a1fb1bac8d2 tempest-VolumesTestJSON-192509201 tempest-VolumesTestJSON-192509201-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/7d480b12-c546-49df-b46a-6a576ff9b7e2" status: 200 len: 351 microversion: 2.1 time: 0.072500 Aug 02 09:18:28.748391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 437/897] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 2 09:18:28 2022] GET /compute/v2.1/os-volumes/7d480b12-c546-49df-b46a-6a576ff9b7e2 => generated 351 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:28.875935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-bcdb2104-9de8-42f0-84af-ed19125d3d9d tempest-VolumesGetTestJSON-1838131553 tempest-VolumesGetTestJSON-1838131553-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.428399 Aug 02 09:18:28.876761 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 461/898] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Aug 2 09:18:27 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1431 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 02 09:18:28.899623 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-bf5f704e-fc8c-4c13-a87c-f02dcfd22ac3 tempest-VolumesGetTestJSON-1838131553 tempest-VolumesGetTestJSON-1838131553-project] Calling method '.version_select at 0x7ffb9a944550>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:28.959752 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-bf5f704e-fc8c-4c13-a87c-f02dcfd22ac3 tempest-VolumesGetTestJSON-1838131553 tempest-VolumesGetTestJSON-1838131553-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/78f25cc4-8661-4760-92f0-6927f58a4fc6" status: 200 len: 352 microversion: 2.1 time: 0.070268 Aug 02 09:18:28.960623 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 438/899] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 2 09:18:28 2022] GET /compute/v2.1/os-volumes/78f25cc4-8661-4760-92f0-6927f58a4fc6 => generated 352 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:29.117337 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-75ec3214-6653-4224-a927-04f912a2db98 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:29.117867 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-75ec3214-6653-4224-a927-04f912a2db98 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:29.129346 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-75ec3214-6653-4224-a927-04f912a2db98 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:29.129972 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-75ec3214-6653-4224-a927-04f912a2db98 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:29.130852 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-75ec3214-6653-4224-a927-04f912a2db98 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:29.132283 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-75ec3214-6653-4224-a927-04f912a2db98 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:29.149087 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-75ec3214-6653-4224-a927-04f912a2db98 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] HTTP exception thrown: Instance 71fb0604-8809-49fd-9b86-e8441c47c2be could not be found. Aug 02 09:18:29.150676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-75ec3214-6653-4224-a927-04f912a2db98 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Request method failure captured: Aug 02 09:18:29.150676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: DELETE /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be HTTP/1.1 Aug 02 09:18:29.150676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:18:29.150676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:18:29.150676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:18:29.150676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:18:29.150676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:18:29.150676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:18:29.150676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:18:29.150676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:29.150676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6OpsBR6h-Hh4LBg89etYcnHlHEfSnLo-qquyYn5hIv5GzaybSFvSkFeeQeiuO6eTSrHwoIsJQSkeHfU0Xu14EgDesftcfDgkuNBpFyG7LZ49WYHglfFft-eRdQuY3tvdcPoOuGiTV3AKukz4BkX7MM2qLdRCP_8VUArgzWtGq8k_Gyo Aug 02 09:18:29.150676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:18:29.150676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:18:29.150676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:18:29.150676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:18:29.150676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:18:29.150676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:18:29.150676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: 696f75fb6c494cfab9deb3d36c3ad599 Aug 02 09:18:29.150676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-AttachVolumeTestJSON-2016443108 Aug 02 09:18:29.150676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:18:29.150676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:18:29.152622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/696f75fb6c494cfab9deb3d36c3ad599"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/696f75fb6c494cfab9deb3d36c3ad599"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/696f75fb6c494cfab9deb3d36c3ad599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_696f75fb6c494cfab9deb3d36c3ad599"}]}] Aug 02 09:18:29.152622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-AttachVolumeTestJSON-2016443108 Aug 02 09:18:29.152622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: 696f75fb6c494cfab9deb3d36c3ad599 Aug 02 09:18:29.152622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2016443108 Aug 02 09:18:29.152622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-AttachVolumeTestJSON-2016443108-project Aug 02 09:18:29.152622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:18:29.152622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:18:29.152622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: 3bccd348dd13473e82ca33c42b840383 Aug 02 09:18:29.152622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-AttachVolumeTestJSON-2016443108-project Aug 02 09:18:29.152622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: > Aug 02 09:18:29.152622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Instance 71fb0604-8809-49fd-9b86-e8441c47c2be could not be found. Aug 02 09:18:29.152622 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': '71fb0604-8809-49fd-9b86-e8441c47c2be'} Aug 02 09:18:29.153619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:29.153619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:29.153619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:29.153619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:29.153619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:29.153619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:29.153619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:29.153619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:29.153619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:29.153619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:29.153619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71fb0604-8809-49fd-9b86-e8441c47c2be could not be found. Aug 02 09:18:29.153619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:29.153619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:29.153619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:29.153619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:29.153619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:29.153619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:29.153619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:29.153619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:29.153619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:29.155111 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:29.155111 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:18:29.155111 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:18:29.155111 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:18:29.155111 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:18:29.155111 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:29.155111 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:29.155111 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:29.155111 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:29.155111 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71fb0604-8809-49fd-9b86-e8441c47c2be could not be found. Aug 02 09:18:29.155111 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:29.155111 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:29.155111 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:29.155111 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:29.155111 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:29.155111 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:29.155111 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:29.155111 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:29.155111 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71fb0604-8809-49fd-9b86-e8441c47c2be could not be found. Aug 02 09:18:29.155111 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:29.156376 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-75ec3214-6653-4224-a927-04f912a2db98 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Returning 404 to user: Instance 71fb0604-8809-49fd-9b86-e8441c47c2be could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:29.156376 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-75ec3214-6653-4224-a927-04f912a2db98 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "DELETE /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be" status: 404 len: 111 microversion: 2.1 time: 0.040170 Aug 02 09:18:29.156376 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 462/900] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:18:29 2022] DELETE /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:18:29.162475 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-23f9485b-5bb5-4b9c-9f67-55372e4cd85c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:29.163193 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-23f9485b-5bb5-4b9c-9f67-55372e4cd85c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 71fb0604-8809-49fd-9b86-e8441c47c2be] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:29.172095 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-23f9485b-5bb5-4b9c-9f67-55372e4cd85c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:29.172634 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-23f9485b-5bb5-4b9c-9f67-55372e4cd85c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:29.173411 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-23f9485b-5bb5-4b9c-9f67-55372e4cd85c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:29.173856 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-23f9485b-5bb5-4b9c-9f67-55372e4cd85c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:29.189931 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-23f9485b-5bb5-4b9c-9f67-55372e4cd85c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] HTTP exception thrown: Instance 71fb0604-8809-49fd-9b86-e8441c47c2be could not be found. Aug 02 09:18:29.191816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-23f9485b-5bb5-4b9c-9f67-55372e4cd85c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Request method failure captured: Aug 02 09:18:29.191816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be HTTP/1.1 Aug 02 09:18:29.191816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:18:29.191816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:18:29.191816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:18:29.191816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:18:29.191816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:18:29.191816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:18:29.191816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:18:29.191816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:29.191816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OpsBR6h-Hh4LBg89etYcnHlHEfSnLo-qquyYn5hIv5GzaybSFvSkFeeQeiuO6eTSrHwoIsJQSkeHfU0Xu14EgDesftcfDgkuNBpFyG7LZ49WYHglfFft-eRdQuY3tvdcPoOuGiTV3AKukz4BkX7MM2qLdRCP_8VUArgzWtGq8k_Gyo Aug 02 09:18:29.191816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:18:29.191816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:18:29.191816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:18:29.191816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:18:29.191816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:18:29.191816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:18:29.191816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: 696f75fb6c494cfab9deb3d36c3ad599 Aug 02 09:18:29.191816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-AttachVolumeTestJSON-2016443108 Aug 02 09:18:29.191816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:18:29.191816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:18:29.193437 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/696f75fb6c494cfab9deb3d36c3ad599"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/696f75fb6c494cfab9deb3d36c3ad599"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/696f75fb6c494cfab9deb3d36c3ad599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_696f75fb6c494cfab9deb3d36c3ad599"}]}] Aug 02 09:18:29.193437 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-AttachVolumeTestJSON-2016443108 Aug 02 09:18:29.193437 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: 696f75fb6c494cfab9deb3d36c3ad599 Aug 02 09:18:29.193437 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2016443108 Aug 02 09:18:29.193437 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-AttachVolumeTestJSON-2016443108-project Aug 02 09:18:29.193437 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:18:29.193437 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:18:29.193437 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: 3bccd348dd13473e82ca33c42b840383 Aug 02 09:18:29.193437 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-AttachVolumeTestJSON-2016443108-project Aug 02 09:18:29.193437 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:18:29.193437 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Instance 71fb0604-8809-49fd-9b86-e8441c47c2be could not be found. Aug 02 09:18:29.193437 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'id': '71fb0604-8809-49fd-9b86-e8441c47c2be'} Aug 02 09:18:29.195533 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:29.195533 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:29.195533 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:29.195533 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:29.195533 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:29.195533 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:29.195533 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:29.195533 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:29.195533 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:29.195533 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:29.195533 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71fb0604-8809-49fd-9b86-e8441c47c2be could not be found. Aug 02 09:18:29.195533 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:29.195533 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:29.195533 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:29.195533 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:29.195533 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:29.195533 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:29.195533 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:29.195533 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:29.195533 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:29.197339 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:29.197339 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:18:29.197339 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:18:29.197339 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:29.197339 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:29.197339 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:29.197339 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:29.197339 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71fb0604-8809-49fd-9b86-e8441c47c2be could not be found. Aug 02 09:18:29.197339 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:29.197339 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:29.197339 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:29.197339 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:29.197339 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:29.197339 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:29.197339 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:29.197339 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:29.197339 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71fb0604-8809-49fd-9b86-e8441c47c2be could not be found. Aug 02 09:18:29.197339 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:29.198546 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-23f9485b-5bb5-4b9c-9f67-55372e4cd85c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Returning 404 to user: Instance 71fb0604-8809-49fd-9b86-e8441c47c2be could not be found. {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:29.198546 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-23f9485b-5bb5-4b9c-9f67-55372e4cd85c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be" status: 404 len: 111 microversion: 2.1 time: 0.037132 Aug 02 09:18:29.198546 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 439/901] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:29 2022] GET /compute/v2.1/servers/71fb0604-8809-49fd-9b86-e8441c47c2be => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:18:29.695169 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-9fb32c6b-12b1-4f34-98b3-6e019d50998f tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:29.696461 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-9fb32c6b-12b1-4f34-98b3-6e019d50998f tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: ade33310-ad5b-4c56-98b9-2754b809d6d7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:29.712745 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9fb32c6b-12b1-4f34-98b3-6e019d50998f tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:29.713520 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9fb32c6b-12b1-4f34-98b3-6e019d50998f tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:29.715355 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9fb32c6b-12b1-4f34-98b3-6e019d50998f tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:29.716268 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9fb32c6b-12b1-4f34-98b3-6e019d50998f tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:29.743193 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-49ba5d4f-8b0e-4182-9398-f72285e2c4cc req-588c84fa-b4f5-4e16-832a-6ae33f3ac042 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ade33310-ad5b-4c56-98b9-2754b809d6d7", "tag": "4c30cb66-4483-4101-8a05-c73b73b46520"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:29.758092 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-49ba5d4f-8b0e-4182-9398-f72285e2c4cc req-588c84fa-b4f5-4e16-832a-6ae33f3ac042 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:29.758806 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-49ba5d4f-8b0e-4182-9398-f72285e2c4cc req-588c84fa-b4f5-4e16-832a-6ae33f3ac042 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:29.771497 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-49ba5d4f-8b0e-4182-9398-f72285e2c4cc req-588c84fa-b4f5-4e16-832a-6ae33f3ac042 service nova] Creating event network-changed:4c30cb66-4483-4101-8a05-c73b73b46520 for instance ade33310-ad5b-4c56-98b9-2754b809d6d7 on hv-cinder-84599 Aug 02 09:18:29.777801 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-49ba5d4f-8b0e-4182-9398-f72285e2c4cc req-588c84fa-b4f5-4e16-832a-6ae33f3ac042 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038829 Aug 02 09:18:29.780150 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 440/902] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:18:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:29.943459 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=2 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:29.976951 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-ba4f00ba-03a6-45c9-8a34-6fc29f74e959 tempest-VolumesGetTestJSON-1838131553 tempest-VolumesGetTestJSON-1838131553-project] Calling method '.version_select at 0x7ffb9aa3c8b0>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:30.050845 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-ba4f00ba-03a6-45c9-8a34-6fc29f74e959 tempest-VolumesGetTestJSON-1838131553 tempest-VolumesGetTestJSON-1838131553-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/78f25cc4-8661-4760-92f0-6927f58a4fc6" status: 200 len: 353 microversion: 2.1 time: 0.080549 Aug 02 09:18:30.051962 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 441/903] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 2 09:18:29 2022] GET /compute/v2.1/os-volumes/78f25cc4-8661-4760-92f0-6927f58a4fc6 => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:30.065748 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-7d69e823-a81c-4fc3-b988-5f7a60b69b74 tempest-VolumesGetTestJSON-1838131553 tempest-VolumesGetTestJSON-1838131553-project] Calling method '.version_select at 0x7ffb9a9fe790>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:30.081500 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-9fb32c6b-12b1-4f34-98b3-6e019d50998f tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:30.090463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-9fb32c6b-12b1-4f34-98b3-6e019d50998f tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7" status: 200 len: 1313 microversion: 2.1 time: 0.401574 Aug 02 09:18:30.112754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 463/904] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:29 2022] GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7 => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:30.159963 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-7d69e823-a81c-4fc3-b988-5f7a60b69b74 tempest-VolumesGetTestJSON-1838131553 tempest-VolumesGetTestJSON-1838131553-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/78f25cc4-8661-4760-92f0-6927f58a4fc6" status: 200 len: 353 microversion: 2.1 time: 0.097458 Aug 02 09:18:30.161075 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 442/905] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 2 09:18:30 2022] GET /compute/v2.1/os-volumes/78f25cc4-8661-4760-92f0-6927f58a4fc6 => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:30.184654 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-86c4359f-a4ab-4b48-b82a-ab2fc498ea9b tempest-VolumesGetTestJSON-1838131553 tempest-VolumesGetTestJSON-1838131553-project] Calling method '.version_select at 0x7ffb9aaf9820>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:30.262294 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-cb2aa545-1bb6-47b3-aeae-804be5777ef3 req-a27b6f17-8b99-4abc-8f09-813709be1940 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c", "tag": "ec5c5fb4-4216-49ff-9a57-3adc12d6b9f9"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:30.342326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-cb2aa545-1bb6-47b3-aeae-804be5777ef3 req-a27b6f17-8b99-4abc-8f09-813709be1940 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:30.342924 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-cb2aa545-1bb6-47b3-aeae-804be5777ef3 req-a27b6f17-8b99-4abc-8f09-813709be1940 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:30.357993 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-cb2aa545-1bb6-47b3-aeae-804be5777ef3 req-a27b6f17-8b99-4abc-8f09-813709be1940 service nova] Creating event network-changed:ec5c5fb4-4216-49ff-9a57-3adc12d6b9f9 for instance 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c on hv-cinder-84599 Aug 02 09:18:30.367827 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-cb2aa545-1bb6-47b3-aeae-804be5777ef3 req-a27b6f17-8b99-4abc-8f09-813709be1940 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111176 Aug 02 09:18:30.367827 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 443/906] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:30.480516 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-86c4359f-a4ab-4b48-b82a-ab2fc498ea9b tempest-VolumesGetTestJSON-1838131553 tempest-VolumesGetTestJSON-1838131553-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/78f25cc4-8661-4760-92f0-6927f58a4fc6" status: 202 len: 0 microversion: 2.1 time: 0.298023 Aug 02 09:18:30.480516 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 464/907] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 2 09:18:30 2022] DELETE /compute/v2.1/os-volumes/78f25cc4-8661-4760-92f0-6927f58a4fc6 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:18:30.487587 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-54f1b36f-873b-4237-b91b-a80506b74f57 tempest-VolumesGetTestJSON-1838131553 tempest-VolumesGetTestJSON-1838131553-project] Calling method '.version_select at 0x7ffb9a9d7550>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:30.544883 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-afe3ec8d-e1f7-4130-8172-c660bd0c2f6c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:30.546882 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-afe3ec8d-e1f7-4130-8172-c660bd0c2f6c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:30.573932 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-afe3ec8d-e1f7-4130-8172-c660bd0c2f6c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:30.574769 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-afe3ec8d-e1f7-4130-8172-c660bd0c2f6c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:30.581530 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-afe3ec8d-e1f7-4130-8172-c660bd0c2f6c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:30.581890 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-afe3ec8d-e1f7-4130-8172-c660bd0c2f6c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:30.621275 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-54f1b36f-873b-4237-b91b-a80506b74f57 tempest-VolumesGetTestJSON-1838131553 tempest-VolumesGetTestJSON-1838131553-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/78f25cc4-8661-4760-92f0-6927f58a4fc6" status: 200 len: 352 microversion: 2.1 time: 0.137197 Aug 02 09:18:30.622872 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 444/908] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 2 09:18:30 2022] GET /compute/v2.1/os-volumes/78f25cc4-8661-4760-92f0-6927f58a4fc6 => generated 352 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:30.635943 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-afe3ec8d-e1f7-4130-8172-c660bd0c2f6c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] HTTP exception thrown: Instance 73c852c4-c5c3-4a1f-94b9-f6515a830bbb could not be found. Aug 02 09:18:30.642496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-afe3ec8d-e1f7-4130-8172-c660bd0c2f6c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Request method failure captured: Aug 02 09:18:30.642496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: DELETE /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb HTTP/1.1 Aug 02 09:18:30.642496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:18:30.642496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:18:30.642496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:18:30.642496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:18:30.642496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:18:30.642496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:18:30.642496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:18:30.642496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:30.642496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6OpsBR6h-Hh4LBg89etYcnHlHEfSnLo-qquyYn5hIv5GzaybSFvSkFeeQeiuO6eTSrHwoIsJQSkeHfU0Xu14EgDesftcfDgkuNBpFyG7LZ49WYHglfFft-eRdQuY3tvdcPoOuGiTV3AKukz4BkX7MM2qLdRCP_8VUArgzWtGq8k_Gyo Aug 02 09:18:30.642496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:18:30.642496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:18:30.642496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:18:30.642496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:18:30.642496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:18:30.642496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:18:30.642496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: 696f75fb6c494cfab9deb3d36c3ad599 Aug 02 09:18:30.642496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-AttachVolumeTestJSON-2016443108 Aug 02 09:18:30.642496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:18:30.642496 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:18:30.644226 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/696f75fb6c494cfab9deb3d36c3ad599"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/696f75fb6c494cfab9deb3d36c3ad599"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/696f75fb6c494cfab9deb3d36c3ad599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_696f75fb6c494cfab9deb3d36c3ad599"}]}] Aug 02 09:18:30.644226 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-AttachVolumeTestJSON-2016443108 Aug 02 09:18:30.644226 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: 696f75fb6c494cfab9deb3d36c3ad599 Aug 02 09:18:30.644226 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2016443108 Aug 02 09:18:30.644226 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-AttachVolumeTestJSON-2016443108-project Aug 02 09:18:30.644226 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:18:30.644226 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:18:30.644226 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: 3bccd348dd13473e82ca33c42b840383 Aug 02 09:18:30.644226 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-AttachVolumeTestJSON-2016443108-project Aug 02 09:18:30.644226 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: > Aug 02 09:18:30.644226 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Instance 73c852c4-c5c3-4a1f-94b9-f6515a830bbb could not be found. Aug 02 09:18:30.644226 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': '73c852c4-c5c3-4a1f-94b9-f6515a830bbb'} Aug 02 09:18:30.645119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:30.645119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:30.645119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:30.645119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:30.645119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:30.645119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:30.645119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:30.645119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:30.645119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:30.645119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:30.645119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73c852c4-c5c3-4a1f-94b9-f6515a830bbb could not be found. Aug 02 09:18:30.645119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:30.645119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:30.645119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:30.645119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:30.645119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:30.645119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:30.645119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:30.645119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:30.645119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:30.646584 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:30.646584 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:18:30.646584 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:18:30.646584 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:18:30.646584 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:18:30.646584 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:30.646584 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:30.646584 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:30.646584 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:30.646584 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73c852c4-c5c3-4a1f-94b9-f6515a830bbb could not be found. Aug 02 09:18:30.646584 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:30.646584 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:30.646584 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:30.646584 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:30.646584 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:30.646584 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:30.646584 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:30.646584 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:30.646584 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73c852c4-c5c3-4a1f-94b9-f6515a830bbb could not be found. Aug 02 09:18:30.646584 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:30.649429 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-afe3ec8d-e1f7-4130-8172-c660bd0c2f6c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Returning 404 to user: Instance 73c852c4-c5c3-4a1f-94b9-f6515a830bbb could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:30.650485 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-afe3ec8d-e1f7-4130-8172-c660bd0c2f6c tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "DELETE /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 404 len: 111 microversion: 2.1 time: 0.113261 Aug 02 09:18:30.661913 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 465/909] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:18:30 2022] DELETE /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:18:30.671788 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-4cc6ff18-5ac8-4d1c-96ad-fe3b1c3f3fd6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:30.680056 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-4cc6ff18-5ac8-4d1c-96ad-fe3b1c3f3fd6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] [instance: 73c852c4-c5c3-4a1f-94b9-f6515a830bbb] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:30.695795 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4cc6ff18-5ac8-4d1c-96ad-fe3b1c3f3fd6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:30.698438 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4cc6ff18-5ac8-4d1c-96ad-fe3b1c3f3fd6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:30.699606 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4cc6ff18-5ac8-4d1c-96ad-fe3b1c3f3fd6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:30.702131 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4cc6ff18-5ac8-4d1c-96ad-fe3b1c3f3fd6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:30.738485 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-4cc6ff18-5ac8-4d1c-96ad-fe3b1c3f3fd6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] HTTP exception thrown: Instance 73c852c4-c5c3-4a1f-94b9-f6515a830bbb could not be found. Aug 02 09:18:30.740262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-4cc6ff18-5ac8-4d1c-96ad-fe3b1c3f3fd6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Request method failure captured: Aug 02 09:18:30.740262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb HTTP/1.1 Aug 02 09:18:30.740262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:18:30.740262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:18:30.740262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:18:30.740262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:18:30.740262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:18:30.740262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:18:30.740262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:18:30.740262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:30.740262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OpsBR6h-Hh4LBg89etYcnHlHEfSnLo-qquyYn5hIv5GzaybSFvSkFeeQeiuO6eTSrHwoIsJQSkeHfU0Xu14EgDesftcfDgkuNBpFyG7LZ49WYHglfFft-eRdQuY3tvdcPoOuGiTV3AKukz4BkX7MM2qLdRCP_8VUArgzWtGq8k_Gyo Aug 02 09:18:30.740262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:18:30.740262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:18:30.740262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:18:30.740262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:18:30.740262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:18:30.740262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:18:30.740262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: 696f75fb6c494cfab9deb3d36c3ad599 Aug 02 09:18:30.740262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-AttachVolumeTestJSON-2016443108 Aug 02 09:18:30.740262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:18:30.740262 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:18:30.746842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/696f75fb6c494cfab9deb3d36c3ad599"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/696f75fb6c494cfab9deb3d36c3ad599"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/696f75fb6c494cfab9deb3d36c3ad599"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_696f75fb6c494cfab9deb3d36c3ad599"}]}] Aug 02 09:18:30.746842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-AttachVolumeTestJSON-2016443108 Aug 02 09:18:30.746842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: 696f75fb6c494cfab9deb3d36c3ad599 Aug 02 09:18:30.746842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2016443108 Aug 02 09:18:30.746842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-AttachVolumeTestJSON-2016443108-project Aug 02 09:18:30.746842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:18:30.746842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:18:30.746842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: 3bccd348dd13473e82ca33c42b840383 Aug 02 09:18:30.746842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-AttachVolumeTestJSON-2016443108-project Aug 02 09:18:30.746842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:18:30.746842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Instance 73c852c4-c5c3-4a1f-94b9-f6515a830bbb could not be found. Aug 02 09:18:30.746842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'id': '73c852c4-c5c3-4a1f-94b9-f6515a830bbb'} Aug 02 09:18:30.747840 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:30.747840 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:30.747840 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:30.747840 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:30.747840 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:30.747840 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:30.747840 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:30.747840 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:30.747840 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:30.747840 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:30.747840 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 73c852c4-c5c3-4a1f-94b9-f6515a830bbb could not be found. Aug 02 09:18:30.747840 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:30.747840 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:30.747840 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:30.747840 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:30.747840 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:30.747840 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:30.747840 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:30.747840 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:30.747840 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:30.749785 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:30.749785 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:18:30.749785 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:18:30.749785 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:30.749785 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:30.749785 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:30.749785 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:30.749785 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 73c852c4-c5c3-4a1f-94b9-f6515a830bbb could not be found. Aug 02 09:18:30.749785 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:30.749785 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:30.749785 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:30.749785 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:30.749785 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:30.749785 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:30.749785 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:30.749785 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:30.749785 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 73c852c4-c5c3-4a1f-94b9-f6515a830bbb could not be found. Aug 02 09:18:30.749785 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:30.751150 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-4cc6ff18-5ac8-4d1c-96ad-fe3b1c3f3fd6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] Returning 404 to user: Instance 73c852c4-c5c3-4a1f-94b9-f6515a830bbb could not be found. {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:30.751150 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-4cc6ff18-5ac8-4d1c-96ad-fe3b1c3f3fd6 tempest-AttachVolumeTestJSON-2016443108 tempest-AttachVolumeTestJSON-2016443108-project] 10.222.0.20 "GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb" status: 404 len: 111 microversion: 2.1 time: 0.077168 Aug 02 09:18:30.753083 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 445/910] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:30 2022] GET /compute/v2.1/servers/73c852c4-c5c3-4a1f-94b9-f6515a830bbb => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:18:30.754723 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-8f2fdd4d-dc12-4729-a8a1-11116c2df8df tempest-VolumesTestJSON-192509201 tempest-VolumesTestJSON-192509201-project] Calling method '.version_select at 0x7ffb9a9aaf70>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:30.901293 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-8f2fdd4d-dc12-4729-a8a1-11116c2df8df tempest-VolumesTestJSON-192509201 tempest-VolumesTestJSON-192509201-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/00d612bc-f9b2-443a-8c39-5e89d7786743" status: 200 len: 351 microversion: 2.1 time: 0.151451 Aug 02 09:18:30.903021 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 466/911] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 2 09:18:30 2022] GET /compute/v2.1/os-volumes/00d612bc-f9b2-443a-8c39-5e89d7786743 => generated 351 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:30.927958 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-e8aa08cd-b114-425c-86d8-85a3b76a169f tempest-VolumesTestJSON-192509201 tempest-VolumesTestJSON-192509201-project] Calling method '.version_select at 0x7ffb9a9fe310>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:31.093371 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-e8aa08cd-b114-425c-86d8-85a3b76a169f tempest-VolumesTestJSON-192509201 tempest-VolumesTestJSON-192509201-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.176328 Aug 02 09:18:31.094018 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 446/912] 10.222.0.20 () {58 vars in 1134 bytes} [Tue Aug 2 09:18:30 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:31.117365 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-72548fc0-c525-4c4c-9d03-2b66eaf9c32c tempest-VolumesTestJSON-192509201 tempest-VolumesTestJSON-192509201-project] Calling method '.version_select at 0x7ffb9a9e9310>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:31.126798 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b981d8b0-5fd0-4700-bb3b-8a27a95d1138 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:31.128043 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b981d8b0-5fd0-4700-bb3b-8a27a95d1138 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: ade33310-ad5b-4c56-98b9-2754b809d6d7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:31.149881 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b981d8b0-5fd0-4700-bb3b-8a27a95d1138 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:31.150340 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b981d8b0-5fd0-4700-bb3b-8a27a95d1138 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:31.151816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b981d8b0-5fd0-4700-bb3b-8a27a95d1138 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:31.151816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b981d8b0-5fd0-4700-bb3b-8a27a95d1138 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:31.327384 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-72548fc0-c525-4c4c-9d03-2b66eaf9c32c tempest-VolumesTestJSON-192509201 tempest-VolumesTestJSON-192509201-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.213478 Aug 02 09:18:31.329341 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 467/913] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Aug 2 09:18:31 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:31.345940 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-b7e0d20f-449b-4884-8cd5-3d5f468a43b4 tempest-VolumesTestJSON-192509201 tempest-VolumesTestJSON-192509201-project] Calling method '.version_select at 0x7ffb9a9e2a60>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:31.466887 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-b7e0d20f-449b-4884-8cd5-3d5f468a43b4 tempest-VolumesTestJSON-192509201 tempest-VolumesTestJSON-192509201-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.126850 Aug 02 09:18:31.467472 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 468/914] 10.222.0.20 () {58 vars in 1134 bytes} [Tue Aug 2 09:18:31 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:31.483942 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-c8feb12e-4c00-437a-822f-dbe876174960 tempest-VolumesTestJSON-192509201 tempest-VolumesTestJSON-192509201-project] Calling method '.version_select at 0x7ffb9a943b80>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:31.599172 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-c8feb12e-4c00-437a-822f-dbe876174960 tempest-VolumesTestJSON-192509201 tempest-VolumesTestJSON-192509201-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.120838 Aug 02 09:18:31.601339 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 469/915] 10.222.0.20 () {58 vars in 1167 bytes} [Tue Aug 2 09:18:31 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:31.619278 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-61cf6c18-d261-44ea-93dc-36660ba6794b tempest-VolumesTestJSON-192509201 tempest-VolumesTestJSON-192509201-project] Calling method '.version_select at 0x7ffb9aafdee0>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:31.720455 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-61cf6c18-d261-44ea-93dc-36660ba6794b tempest-VolumesTestJSON-192509201 tempest-VolumesTestJSON-192509201-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.105618 Aug 02 09:18:31.721032 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 470/916] 10.222.0.20 () {58 vars in 1170 bytes} [Tue Aug 2 09:18:31 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:31.726625 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4451ffcc-d5a3-494b-8ffb-c294cc211705 tempest-VolumesGetTestJSON-1838131553 tempest-VolumesGetTestJSON-1838131553-project] Calling method '.version_select at 0x7ffb9a943820>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:31.773329 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-4451ffcc-d5a3-494b-8ffb-c294cc211705 tempest-VolumesGetTestJSON-1838131553 tempest-VolumesGetTestJSON-1838131553-project] HTTP exception thrown: Volume 78f25cc4-8661-4760-92f0-6927f58a4fc6 could not be found. Aug 02 09:18:31.775484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4451ffcc-d5a3-494b-8ffb-c294cc211705 tempest-VolumesGetTestJSON-1838131553 tempest-VolumesGetTestJSON-1838131553-project] Request method failure captured: Aug 02 09:18:31.775484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: GET /compute/v2.1/os-volumes/78f25cc4-8661-4760-92f0-6927f58a4fc6 HTTP/1.1 Aug 02 09:18:31.775484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:18:31.775484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:18:31.775484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:18:31.775484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:18:31.775484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:18:31.775484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:18:31.775484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:18:31.775484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:31.775484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6Ovjn3nrs9wGgtJPwrpRVdCNS2uke_eKQwrbrlAe8t6lJkWso7R3V9R62bneblE7N4CPlGYaDoNnlCyZnRMB1sP-7KOZIVPQXBMkZeqP3nVvQNysaP_J51MRWyZ6N420qFwd3VPIw0CsCUtVtOJvPRKsDhScsuTrpNCL7cuMimUEUic Aug 02 09:18:31.775484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:18:31.775484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:18:31.775484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:18:31.775484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:18:31.775484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:18:31.775484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:18:31.775484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: 1a4ff11abfb542228b187adce5b9e2d1 Aug 02 09:18:31.775484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-VolumesGetTestJSON-1838131553 Aug 02 09:18:31.775484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:18:31.775484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:18:31.776940 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4ff11abfb542228b187adce5b9e2d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/1a4ff11abfb542228b187adce5b9e2d1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/1a4ff11abfb542228b187adce5b9e2d1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_1a4ff11abfb542228b187adce5b9e2d1"}]}] Aug 02 09:18:31.776940 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-VolumesGetTestJSON-1838131553 Aug 02 09:18:31.776940 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: 1a4ff11abfb542228b187adce5b9e2d1 Aug 02 09:18:31.776940 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-VolumesGetTestJSON-1838131553 Aug 02 09:18:31.776940 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-VolumesGetTestJSON-1838131553-project Aug 02 09:18:31.776940 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:18:31.776940 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:18:31.776940 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: a732f16918a94426a1add97e1e8b3105 Aug 02 09:18:31.776940 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-VolumesGetTestJSON-1838131553-project Aug 02 09:18:31.776940 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: Aug 02 09:18:31.776940 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Volume 78f25cc4-8661-4760-92f0-6927f58a4fc6 could not be found. Aug 02 09:18:31.776940 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': '78f25cc4-8661-4760-92f0-6927f58a4fc6'} Aug 02 09:18:31.776940 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:31.777795 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:31.777795 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:18:31.777795 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:18:31.777795 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:18:31.777795 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:18:31.777795 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:18:31.777795 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:18:31.777795 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:18:31.777795 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:18:31.777795 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:18:31.777795 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:18:31.777795 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:18:31.777795 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:18:31.777795 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:18:31.777795 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:18:31.777795 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 78f25cc4-8661-4760-92f0-6927f58a4fc6 could not be found. (HTTP 404) (Request-ID: req-59a6f653-06b3-437e-bd63-8a46da7de965) Aug 02 09:18:31.777795 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:31.777795 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:31.777795 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:31.779076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:31.779076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 02 09:18:31.779076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 02 09:18:31.779076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 02 09:18:31.779076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 02 09:18:31.779076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 02 09:18:31.779076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 02 09:18:31.779076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 02 09:18:31.779076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 02 09:18:31.779076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 02 09:18:31.779076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 02 09:18:31.779076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 02 09:18:31.779076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 02 09:18:31.779076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 02 09:18:31.779076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 02 09:18:31.779076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 02 09:18:31.779076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 02 09:18:31.779076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 02 09:18:31.779076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 02 09:18:31.780354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 02 09:18:31.780354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 02 09:18:31.780354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 02 09:18:31.780354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 02 09:18:31.780354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 78f25cc4-8661-4760-92f0-6927f58a4fc6 could not be found. Aug 02 09:18:31.780354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:31.780354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:31.780354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:31.780354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:31.780354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:31.780354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:31.780354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:31.780354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:31.780354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 02 09:18:31.780354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 02 09:18:31.780354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:31.780354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:31.780354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 02 09:18:31.780354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:31.782007 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 78f25cc4-8661-4760-92f0-6927f58a4fc6 could not be found. Aug 02 09:18:31.782007 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:31.782007 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:31.782007 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:31.782007 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:31.782007 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:31.782007 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:31.782007 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:31.782007 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:31.782007 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 78f25cc4-8661-4760-92f0-6927f58a4fc6 could not be found. Aug 02 09:18:31.782007 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:18:31.782007 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4451ffcc-d5a3-494b-8ffb-c294cc211705 tempest-VolumesGetTestJSON-1838131553 tempest-VolumesGetTestJSON-1838131553-project] Returning 404 to user: Volume 78f25cc4-8661-4760-92f0-6927f58a4fc6 could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:31.782007 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-4451ffcc-d5a3-494b-8ffb-c294cc211705 tempest-VolumesGetTestJSON-1838131553 tempest-VolumesGetTestJSON-1838131553-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/78f25cc4-8661-4760-92f0-6927f58a4fc6" status: 404 len: 109 microversion: 2.1 time: 0.054824 Aug 02 09:18:31.782007 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 471/917] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 2 09:18:31 2022] GET /compute/v2.1/os-volumes/78f25cc4-8661-4760-92f0-6927f58a4fc6 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:18:31.786303 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-bdacc715-7da3-467d-bf04-09282d25173a tempest-VolumesTestJSON-192509201 tempest-VolumesTestJSON-192509201-project] Calling method '.version_select at 0x7ffb9a9e2af0>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:31.838529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=10 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:31.893022 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-bdacc715-7da3-467d-bf04-09282d25173a tempest-VolumesTestJSON-192509201 tempest-VolumesTestJSON-192509201-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.113208 Aug 02 09:18:31.895044 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 472/918] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Aug 2 09:18:31 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:31.909762 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-36722fae-6994-44c7-902b-89d99118af18 tempest-VolumesTestJSON-192509201 tempest-VolumesTestJSON-192509201-project] Calling method '.version_select at 0x7ffb9a943f70>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:32.017345 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-36722fae-6994-44c7-902b-89d99118af18 tempest-VolumesTestJSON-192509201 tempest-VolumesTestJSON-192509201-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.112103 Aug 02 09:18:32.018034 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 473/919] 10.222.0.20 () {58 vars in 1188 bytes} [Tue Aug 2 09:18:31 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:32.034039 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-49f50c4e-f1cd-40e7-a08e-cc12a6c06cc6 tempest-VolumesTestJSON-192509201 tempest-VolumesTestJSON-192509201-project] Calling method '.version_select at 0x7ffb9aaed430>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:32.144948 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-49f50c4e-f1cd-40e7-a08e-cc12a6c06cc6 tempest-VolumesTestJSON-192509201 tempest-VolumesTestJSON-192509201-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.104665 Aug 02 09:18:32.144948 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 474/920] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Aug 2 09:18:32 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:32.217061 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b981d8b0-5fd0-4700-bb3b-8a27a95d1138 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:32.228209 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b981d8b0-5fd0-4700-bb3b-8a27a95d1138 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7" status: 200 len: 1313 microversion: 2.1 time: 1.106296 Aug 02 09:18:32.228773 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 447/921] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:31 2022] GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7 => generated 1313 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:33.252210 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-3f0bab8d-2a6d-491e-85bc-79b287c50c4d tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:33.253558 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-3f0bab8d-2a6d-491e-85bc-79b287c50c4d tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: ade33310-ad5b-4c56-98b9-2754b809d6d7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:33.261581 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3f0bab8d-2a6d-491e-85bc-79b287c50c4d tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:33.262118 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3f0bab8d-2a6d-491e-85bc-79b287c50c4d tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:33.262973 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3f0bab8d-2a6d-491e-85bc-79b287c50c4d tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:33.263569 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3f0bab8d-2a6d-491e-85bc-79b287c50c4d tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:33.602605 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-3f0bab8d-2a6d-491e-85bc-79b287c50c4d tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:33.611415 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-3f0bab8d-2a6d-491e-85bc-79b287c50c4d tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7" status: 200 len: 1313 microversion: 2.1 time: 0.364185 Aug 02 09:18:33.611995 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 475/922] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:33 2022] GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7 => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:34.648411 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-02c4eb3a-725e-4b5e-b5f3-bf81b71ab6e4 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:34.649144 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-02c4eb3a-725e-4b5e-b5f3-bf81b71ab6e4 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: ade33310-ad5b-4c56-98b9-2754b809d6d7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:34.658883 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-02c4eb3a-725e-4b5e-b5f3-bf81b71ab6e4 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.659990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-02c4eb3a-725e-4b5e-b5f3-bf81b71ab6e4 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:34.661685 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-02c4eb3a-725e-4b5e-b5f3-bf81b71ab6e4 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:34.662470 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-02c4eb3a-725e-4b5e-b5f3-bf81b71ab6e4 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:35.312871 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-02c4eb3a-725e-4b5e-b5f3-bf81b71ab6e4 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:35.328304 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-02c4eb3a-725e-4b5e-b5f3-bf81b71ab6e4 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7" status: 200 len: 1313 microversion: 2.1 time: 0.685419 Aug 02 09:18:35.345117 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 448/923] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:34 2022] GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7 => generated 1313 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:36.364560 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-45e3e562-5bdc-4bdd-bee4-955cf4737cf4 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:36.366767 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-45e3e562-5bdc-4bdd-bee4-955cf4737cf4 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: ade33310-ad5b-4c56-98b9-2754b809d6d7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:36.402201 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-45e3e562-5bdc-4bdd-bee4-955cf4737cf4 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:36.403424 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-45e3e562-5bdc-4bdd-bee4-955cf4737cf4 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:36.409519 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-45e3e562-5bdc-4bdd-bee4-955cf4737cf4 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:36.410246 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-45e3e562-5bdc-4bdd-bee4-955cf4737cf4 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:36.957213 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-45e3e562-5bdc-4bdd-bee4-955cf4737cf4 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:36.983108 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-45e3e562-5bdc-4bdd-bee4-955cf4737cf4 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7" status: 200 len: 1313 microversion: 2.1 time: 0.627739 Aug 02 09:18:36.994366 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 476/924] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:36 2022] GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7 => generated 1313 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:38.030786 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-5314b25b-bf98-4552-9e7a-3eb1d6ac77cd tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:38.031704 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-5314b25b-bf98-4552-9e7a-3eb1d6ac77cd tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: ade33310-ad5b-4c56-98b9-2754b809d6d7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:38.043463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5314b25b-bf98-4552-9e7a-3eb1d6ac77cd tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:38.044348 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5314b25b-bf98-4552-9e7a-3eb1d6ac77cd tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:38.045541 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5314b25b-bf98-4552-9e7a-3eb1d6ac77cd tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:38.046494 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5314b25b-bf98-4552-9e7a-3eb1d6ac77cd tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:38.451397 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-bb19ac75-95e2-49ba-bad0-7d349cc4e195 req-8a07f074-dbb2-495d-90dc-635944ec8876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade33310-ad5b-4c56-98b9-2754b809d6d7", "name": "network-vif-plugged", "status": "completed", "tag": "4c30cb66-4483-4101-8a05-c73b73b46520"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:38.477427 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-bb19ac75-95e2-49ba-bad0-7d349cc4e195 req-8a07f074-dbb2-495d-90dc-635944ec8876 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:38.478425 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-bb19ac75-95e2-49ba-bad0-7d349cc4e195 req-8a07f074-dbb2-495d-90dc-635944ec8876 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:38.508912 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-bb19ac75-95e2-49ba-bad0-7d349cc4e195 req-8a07f074-dbb2-495d-90dc-635944ec8876 service nova] Creating event network-vif-plugged:4c30cb66-4483-4101-8a05-c73b73b46520 for instance ade33310-ad5b-4c56-98b9-2754b809d6d7 on hv-cinder-84599 Aug 02 09:18:38.524923 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-bb19ac75-95e2-49ba-bad0-7d349cc4e195 req-8a07f074-dbb2-495d-90dc-635944ec8876 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079719 Aug 02 09:18:38.526348 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 477/925] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:18:38.675673 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-5314b25b-bf98-4552-9e7a-3eb1d6ac77cd tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:38.726549 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-5314b25b-bf98-4552-9e7a-3eb1d6ac77cd tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7" status: 200 len: 1313 microversion: 2.1 time: 0.703619 Aug 02 09:18:38.743608 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 449/926] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:38 2022] GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7 => generated 1313 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:39.778432 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-8103847a-9987-41ac-a1ea-8ccbeaf0da73 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:39.781167 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-8103847a-9987-41ac-a1ea-8ccbeaf0da73 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: ade33310-ad5b-4c56-98b9-2754b809d6d7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:39.802303 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:39.806913 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8103847a-9987-41ac-a1ea-8ccbeaf0da73 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:39.808702 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8103847a-9987-41ac-a1ea-8ccbeaf0da73 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:39.811329 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8103847a-9987-41ac-a1ea-8ccbeaf0da73 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:39.812554 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8103847a-9987-41ac-a1ea-8ccbeaf0da73 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:40.114591 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-8103847a-9987-41ac-a1ea-8ccbeaf0da73 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:40.127139 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-8103847a-9987-41ac-a1ea-8ccbeaf0da73 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7" status: 200 len: 1313 microversion: 2.1 time: 0.364605 Aug 02 09:18:40.129225 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 478/927] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:39 2022] GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7 => generated 1313 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:41.152597 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-fc566e88-bbd6-4a00-ab11-efd901405092 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:41.153321 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-fc566e88-bbd6-4a00-ab11-efd901405092 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: ade33310-ad5b-4c56-98b9-2754b809d6d7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:41.164423 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fc566e88-bbd6-4a00-ab11-efd901405092 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:41.165456 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fc566e88-bbd6-4a00-ab11-efd901405092 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:41.166402 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fc566e88-bbd6-4a00-ab11-efd901405092 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:41.166918 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fc566e88-bbd6-4a00-ab11-efd901405092 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:41.926142 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-fc566e88-bbd6-4a00-ab11-efd901405092 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:41.939518 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-fc566e88-bbd6-4a00-ab11-efd901405092 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7" status: 200 len: 1313 microversion: 2.1 time: 0.792527 Aug 02 09:18:41.940446 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 450/928] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:41 2022] GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7 => generated 1313 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:42.971148 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-9ed9542b-48ed-4257-adcc-fafd4e924369 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:42.974628 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-9ed9542b-48ed-4257-adcc-fafd4e924369 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: ade33310-ad5b-4c56-98b9-2754b809d6d7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:42.989588 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9ed9542b-48ed-4257-adcc-fafd4e924369 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:42.990906 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9ed9542b-48ed-4257-adcc-fafd4e924369 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:42.995260 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9ed9542b-48ed-4257-adcc-fafd4e924369 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:42.996094 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9ed9542b-48ed-4257-adcc-fafd4e924369 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:43.372608 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-9ed9542b-48ed-4257-adcc-fafd4e924369 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:43.383193 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-9ed9542b-48ed-4257-adcc-fafd4e924369 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7" status: 200 len: 1498 microversion: 2.1 time: 0.422995 Aug 02 09:18:43.383991 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 479/929] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:42 2022] GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7 => generated 1498 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:44.795925 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-3437c889-1d04-44f1-85ed-680eef3644ab tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:44.796595 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-3437c889-1d04-44f1-85ed-680eef3644ab tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: ade33310-ad5b-4c56-98b9-2754b809d6d7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:44.808050 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3437c889-1d04-44f1-85ed-680eef3644ab tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:44.810895 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3437c889-1d04-44f1-85ed-680eef3644ab tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:44.810895 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3437c889-1d04-44f1-85ed-680eef3644ab tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:44.811318 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3437c889-1d04-44f1-85ed-680eef3644ab tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:45.046816 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-3437c889-1d04-44f1-85ed-680eef3644ab tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: ade33310-ad5b-4c56-98b9-2754b809d6d7] Going to try to terminate instance {{(pid=118526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:18:45.426359 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-3437c889-1d04-44f1-85ed-680eef3644ab tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7" status: 204 len: 0 microversion: 2.1 time: 0.637464 Aug 02 09:18:45.427807 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 451/930] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:18:44 2022] DELETE /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:18:45.437894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-95f2903c-cacd-4d4c-9ea3-0b9fd4b547db tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:45.440488 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-95f2903c-cacd-4d4c-9ea3-0b9fd4b547db tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: ade33310-ad5b-4c56-98b9-2754b809d6d7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:45.451005 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-95f2903c-cacd-4d4c-9ea3-0b9fd4b547db tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:45.451523 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-95f2903c-cacd-4d4c-9ea3-0b9fd4b547db tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:45.453032 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-95f2903c-cacd-4d4c-9ea3-0b9fd4b547db tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:45.453659 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-95f2903c-cacd-4d4c-9ea3-0b9fd4b547db tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:45.732276 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-95f2903c-cacd-4d4c-9ea3-0b9fd4b547db tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:45.742471 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-95f2903c-cacd-4d4c-9ea3-0b9fd4b547db tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7" status: 200 len: 1504 microversion: 2.1 time: 0.308932 Aug 02 09:18:45.743063 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 480/931] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:45 2022] GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7 => generated 1504 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:46.767202 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-f15f9623-ae33-4366-815d-e13e37ee5b7b tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:46.768427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-f15f9623-ae33-4366-815d-e13e37ee5b7b tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: ade33310-ad5b-4c56-98b9-2754b809d6d7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:46.779239 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f15f9623-ae33-4366-815d-e13e37ee5b7b tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:46.779943 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f15f9623-ae33-4366-815d-e13e37ee5b7b tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:46.780814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f15f9623-ae33-4366-815d-e13e37ee5b7b tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:46.781257 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f15f9623-ae33-4366-815d-e13e37ee5b7b tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:47.090855 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-f15f9623-ae33-4366-815d-e13e37ee5b7b tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:47.105396 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-f15f9623-ae33-4366-815d-e13e37ee5b7b tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7" status: 200 len: 1504 microversion: 2.1 time: 0.343723 Aug 02 09:18:47.107376 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 452/932] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:46 2022] GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7 => generated 1504 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:47.961601 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-6f682c2e-92ca-4af7-91c6-df0d3116d844 req-05fbae17-bd95-43c0-94f4-6670fe768dae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ade33310-ad5b-4c56-98b9-2754b809d6d7", "name": "network-vif-deleted", "tag": "4c30cb66-4483-4101-8a05-c73b73b46520"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:47.986248 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-6f682c2e-92ca-4af7-91c6-df0d3116d844 req-05fbae17-bd95-43c0-94f4-6670fe768dae service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:47.986960 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-6f682c2e-92ca-4af7-91c6-df0d3116d844 req-05fbae17-bd95-43c0-94f4-6670fe768dae service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:48.001978 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-6f682c2e-92ca-4af7-91c6-df0d3116d844 req-05fbae17-bd95-43c0-94f4-6670fe768dae service nova] Creating event network-vif-deleted:4c30cb66-4483-4101-8a05-c73b73b46520 for instance ade33310-ad5b-4c56-98b9-2754b809d6d7 on hv-cinder-84599 Aug 02 09:18:48.012064 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-6f682c2e-92ca-4af7-91c6-df0d3116d844 req-05fbae17-bd95-43c0-94f4-6670fe768dae service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055242 Aug 02 09:18:48.012711 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 481/933] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:48.151335 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-e05685bc-9326-4ceb-a626-7e90fbebd895 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:48.152377 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-e05685bc-9326-4ceb-a626-7e90fbebd895 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: ade33310-ad5b-4c56-98b9-2754b809d6d7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:48.169809 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e05685bc-9326-4ceb-a626-7e90fbebd895 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:48.175402 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e05685bc-9326-4ceb-a626-7e90fbebd895 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:48.176265 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e05685bc-9326-4ceb-a626-7e90fbebd895 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:48.176988 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e05685bc-9326-4ceb-a626-7e90fbebd895 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:48.308874 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-e05685bc-9326-4ceb-a626-7e90fbebd895 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:48.322483 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-e05685bc-9326-4ceb-a626-7e90fbebd895 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7" status: 200 len: 1298 microversion: 2.1 time: 0.179791 Aug 02 09:18:48.329181 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 453/934] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:48 2022] GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7 => generated 1298 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:49.351021 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-f0078d70-77fb-496f-bec4-3a3d9c6779a3 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:49.352412 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-f0078d70-77fb-496f-bec4-3a3d9c6779a3 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: ade33310-ad5b-4c56-98b9-2754b809d6d7] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:49.363794 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f0078d70-77fb-496f-bec4-3a3d9c6779a3 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:49.364431 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f0078d70-77fb-496f-bec4-3a3d9c6779a3 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:49.366984 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f0078d70-77fb-496f-bec4-3a3d9c6779a3 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:49.369403 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f0078d70-77fb-496f-bec4-3a3d9c6779a3 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:49.374248 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=98 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:49.420755 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f0078d70-77fb-496f-bec4-3a3d9c6779a3 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:49.421347 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-f0078d70-77fb-496f-bec4-3a3d9c6779a3 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:49.421912 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.objects.instance [None req-f0078d70-77fb-496f-bec4-3a3d9c6779a3 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lazy-loading 'fault' on Instance uuid ade33310-ad5b-4c56-98b9-2754b809d6d7 {{(pid=118525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:18:49.503736 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-f0078d70-77fb-496f-bec4-3a3d9c6779a3 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:49.518860 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-f0078d70-77fb-496f-bec4-3a3d9c6779a3 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7" status: 200 len: 1303 microversion: 2.1 time: 0.175689 Aug 02 09:18:49.519822 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 482/935] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:49 2022] GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7 => generated 1303 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:50.549361 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-748d5b6d-20a7-458a-bc85-2ba395ac3733 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:50.550062 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-748d5b6d-20a7-458a-bc85-2ba395ac3733 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: ade33310-ad5b-4c56-98b9-2754b809d6d7] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:50.555078 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:18:50.563969 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-748d5b6d-20a7-458a-bc85-2ba395ac3733 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:50.564468 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-748d5b6d-20a7-458a-bc85-2ba395ac3733 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:50.565361 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-748d5b6d-20a7-458a-bc85-2ba395ac3733 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:50.565894 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-748d5b6d-20a7-458a-bc85-2ba395ac3733 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:50.586534 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-748d5b6d-20a7-458a-bc85-2ba395ac3733 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] HTTP exception thrown: Instance ade33310-ad5b-4c56-98b9-2754b809d6d7 could not be found. Aug 02 09:18:50.593146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-748d5b6d-20a7-458a-bc85-2ba395ac3733 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Request method failure captured: Aug 02 09:18:50.593146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7 HTTP/1.1 Aug 02 09:18:50.593146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:18:50.593146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:18:50.593146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:18:50.593146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:18:50.593146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:18:50.593146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:18:50.593146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:18:50.593146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:18:50.593146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OvX40u4gQBfCQVVWxh0CauGdAD30PsNW6hEWAjY8pduSIj7VMBmei1mx53DCAB9fupJntkgwRQmShPkHPLeZHzelsP7w1LoJuXN5aChkNoM0Gs2OuY_ITrTrimwYMWIBDxPLlzNY3MDGGOuaniDo_ElXvzReglOs2bZHVcoqmskcsM Aug 02 09:18:50.593146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:18:50.593146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:18:50.593146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:18:50.593146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:18:50.593146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:18:50.593146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:18:50.593146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: f15f389a69d249adaa55b25d60e54ab0 Aug 02 09:18:50.593146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-VolumesActionsTest-420312351 Aug 02 09:18:50.593146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:18:50.593146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:18:50.597463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f15f389a69d249adaa55b25d60e54ab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f15f389a69d249adaa55b25d60e54ab0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f15f389a69d249adaa55b25d60e54ab0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f15f389a69d249adaa55b25d60e54ab0"}]}] Aug 02 09:18:50.597463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-VolumesActionsTest-420312351 Aug 02 09:18:50.597463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: f15f389a69d249adaa55b25d60e54ab0 Aug 02 09:18:50.597463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-VolumesActionsTest-420312351 Aug 02 09:18:50.597463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-VolumesActionsTest-420312351-project Aug 02 09:18:50.597463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:18:50.597463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:18:50.597463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: 6cd2f7ae47fd42929ccfaed668c5a55f Aug 02 09:18:50.597463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-VolumesActionsTest-420312351-project Aug 02 09:18:50.597463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:18:50.597463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Instance ade33310-ad5b-4c56-98b9-2754b809d6d7 could not be found. Aug 02 09:18:50.597463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'id': 'ade33310-ad5b-4c56-98b9-2754b809d6d7'} Aug 02 09:18:50.598880 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:18:50.598880 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:50.598880 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:18:50.598880 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:18:50.598880 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:18:50.598880 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:18:50.598880 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:18:50.598880 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:18:50.598880 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:18:50.598880 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:18:50.598880 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ade33310-ad5b-4c56-98b9-2754b809d6d7 could not be found. Aug 02 09:18:50.598880 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:50.598880 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:50.598880 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:50.598880 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:50.598880 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:50.598880 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:50.598880 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:18:50.598880 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:18:50.598880 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:18:50.601800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:18:50.601800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:18:50.601800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:18:50.601800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:18:50.601800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:18:50.601800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:18:50.601800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:18:50.601800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ade33310-ad5b-4c56-98b9-2754b809d6d7 could not be found. Aug 02 09:18:50.601800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:50.601800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:18:50.601800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:50.601800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:18:50.601800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:18:50.601800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:18:50.601800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:18:50.601800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:18:50.601800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ade33310-ad5b-4c56-98b9-2754b809d6d7 could not be found. Aug 02 09:18:50.601800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:18:50.604026 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-748d5b6d-20a7-458a-bc85-2ba395ac3733 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Returning 404 to user: Instance ade33310-ad5b-4c56-98b9-2754b809d6d7 could not be found. {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:18:50.604026 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-748d5b6d-20a7-458a-bc85-2ba395ac3733 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7" status: 404 len: 111 microversion: 2.1 time: 0.047511 Aug 02 09:18:50.604026 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 454/936] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:50 2022] GET /compute/v2.1/servers/ade33310-ad5b-4c56-98b9-2754b809d6d7 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:18:50.757290 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-8b454d2b-fe4e-4d0c-8adc-a6085c6b4547 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1041997236", "imageRef": "7a52f4c5-c531-494a-b375-4f6dce3abbc2", "flavorRef": "452", "networks": [{"uuid": "a3629eac-1176-4926-9ce9-18b868d39937"}]}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:50.817419 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.network.neutron [None req-8b454d2b-fe4e-4d0c-8adc-a6085c6b4547 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] validate_networks() for [('a3629eac-1176-4926-9ce9-18b868d39937', None, None, None, None, None)] {{(pid=118525) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:18:51.381523 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-8b454d2b-fe4e-4d0c-8adc-a6085c6b4547 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Flavor limits 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:18:51.382427 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-8b454d2b-fe4e-4d0c-8adc-a6085c6b4547 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Image limits 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:18:51.382895 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-8b454d2b-fe4e-4d0c-8adc-a6085c6b4547 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Flavor pref 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:18:51.383564 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-8b454d2b-fe4e-4d0c-8adc-a6085c6b4547 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Image pref 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:18:51.384120 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-8b454d2b-fe4e-4d0c-8adc-a6085c6b4547 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:18:51.395963 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8b454d2b-fe4e-4d0c-8adc-a6085c6b4547 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:51.400631 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8b454d2b-fe4e-4d0c-8adc-a6085c6b4547 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:51.400631 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8b454d2b-fe4e-4d0c-8adc-a6085c6b4547 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:51.400631 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8b454d2b-fe4e-4d0c-8adc-a6085c6b4547 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:51.424552 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-8b454d2b-fe4e-4d0c-8adc-a6085c6b4547 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Getting quotas for project f15f389a69d249adaa55b25d60e54ab0. Resources: {'cores', 'ram', 'instances'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:18:51.433570 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-8b454d2b-fe4e-4d0c-8adc-a6085c6b4547 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Getting quotas for user 6cd2f7ae47fd42929ccfaed668c5a55f and project f15f389a69d249adaa55b25d60e54ab0. Resources: {'cores', 'ram', 'instances'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:18:51.451387 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-8b454d2b-fe4e-4d0c-8adc-a6085c6b4547 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Going to run 1 instances... {{(pid=118525) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:18:51.454043 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-8b454d2b-fe4e-4d0c-8adc-a6085c6b4547 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: 00edf329-01da-482b-b5ab-476ec4f3ba74] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7a52f4c5-c531-494a-b375-4f6dce3abbc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118525) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:18:51.805887 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-8b454d2b-fe4e-4d0c-8adc-a6085c6b4547 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.057125 Aug 02 09:18:51.806943 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 483/937] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 2 09:18:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:18:51.835768 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-e42b1409-07e3-4740-bed3-0f343f08a836 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:51.835768 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-e42b1409-07e3-4740-bed3-0f343f08a836 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: 00edf329-01da-482b-b5ab-476ec4f3ba74] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:51.900821 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-e42b1409-07e3-4740-bed3-0f343f08a836 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:51.912036 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-e42b1409-07e3-4740-bed3-0f343f08a836 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74" status: 200 len: 1214 microversion: 2.1 time: 0.093142 Aug 02 09:18:51.913059 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 455/938] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:51 2022] GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74 => generated 1214 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:52.948215 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-17c5acce-afe9-48fc-b01b-c1eb2524570d tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:52.949410 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-17c5acce-afe9-48fc-b01b-c1eb2524570d tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: 00edf329-01da-482b-b5ab-476ec4f3ba74] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:52.957663 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-17c5acce-afe9-48fc-b01b-c1eb2524570d tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:52.958555 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-17c5acce-afe9-48fc-b01b-c1eb2524570d tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:52.959608 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-17c5acce-afe9-48fc-b01b-c1eb2524570d tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:52.960852 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-17c5acce-afe9-48fc-b01b-c1eb2524570d tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:53.072641 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-17c5acce-afe9-48fc-b01b-c1eb2524570d tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:53.089401 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-17c5acce-afe9-48fc-b01b-c1eb2524570d tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74" status: 200 len: 1218 microversion: 2.1 time: 0.143355 Aug 02 09:18:53.090151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 484/939] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:52 2022] GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74 => generated 1218 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:18:54.119641 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b8047423-c50c-4ebd-836a-36e4ef19c25b tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:54.120421 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b8047423-c50c-4ebd-836a-36e4ef19c25b tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: 00edf329-01da-482b-b5ab-476ec4f3ba74] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:54.128916 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b8047423-c50c-4ebd-836a-36e4ef19c25b tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:54.129414 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b8047423-c50c-4ebd-836a-36e4ef19c25b tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:54.130238 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b8047423-c50c-4ebd-836a-36e4ef19c25b tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:54.131483 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b8047423-c50c-4ebd-836a-36e4ef19c25b tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:54.238406 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b8047423-c50c-4ebd-836a-36e4ef19c25b tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:54.247439 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b8047423-c50c-4ebd-836a-36e4ef19c25b tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74" status: 200 len: 1266 microversion: 2.1 time: 0.133071 Aug 02 09:18:54.248271 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 456/940] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:54 2022] GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74 => generated 1266 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:55.316281 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-25af504e-9809-462b-acc8-d23be5d8343f tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:55.321492 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-25af504e-9809-462b-acc8-d23be5d8343f tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: 00edf329-01da-482b-b5ab-476ec4f3ba74] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:55.343680 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-25af504e-9809-462b-acc8-d23be5d8343f tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:55.345090 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-25af504e-9809-462b-acc8-d23be5d8343f tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:55.347915 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-25af504e-9809-462b-acc8-d23be5d8343f tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:55.353124 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-25af504e-9809-462b-acc8-d23be5d8343f tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:55.543309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-25af504e-9809-462b-acc8-d23be5d8343f tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:55.563597 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-25af504e-9809-462b-acc8-d23be5d8343f tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74" status: 200 len: 1284 microversion: 2.1 time: 0.261645 Aug 02 09:18:55.566979 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 485/941] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:55 2022] GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74 => generated 1284 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:56.589671 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a7a8bd6c-6e1d-4460-b91d-c60c9218ac9c tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:56.590969 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-a7a8bd6c-6e1d-4460-b91d-c60c9218ac9c tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: 00edf329-01da-482b-b5ab-476ec4f3ba74] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:56.598482 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a7a8bd6c-6e1d-4460-b91d-c60c9218ac9c tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:56.598880 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a7a8bd6c-6e1d-4460-b91d-c60c9218ac9c tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:56.599892 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a7a8bd6c-6e1d-4460-b91d-c60c9218ac9c tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:56.600366 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a7a8bd6c-6e1d-4460-b91d-c60c9218ac9c tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:56.813792 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-a7a8bd6c-6e1d-4460-b91d-c60c9218ac9c tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:56.829989 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-a7a8bd6c-6e1d-4460-b91d-c60c9218ac9c tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74" status: 200 len: 1314 microversion: 2.1 time: 0.243953 Aug 02 09:18:56.831278 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 457/942] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:56 2022] GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:57.517384 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-a0740199-bfc4-4493-bef7-dce20f322202 req-f3d56dd7-cdae-4c5c-a59f-4abee33e045d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "00edf329-01da-482b-b5ab-476ec4f3ba74", "tag": "4245fb4e-a860-4b04-9fba-526102830ad4"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:18:57.547706 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-a0740199-bfc4-4493-bef7-dce20f322202 req-f3d56dd7-cdae-4c5c-a59f-4abee33e045d service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:57.548153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-a0740199-bfc4-4493-bef7-dce20f322202 req-f3d56dd7-cdae-4c5c-a59f-4abee33e045d service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:57.569608 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-a0740199-bfc4-4493-bef7-dce20f322202 req-f3d56dd7-cdae-4c5c-a59f-4abee33e045d service nova] Creating event network-changed:4245fb4e-a860-4b04-9fba-526102830ad4 for instance 00edf329-01da-482b-b5ab-476ec4f3ba74 on hv-cinder-84599 Aug 02 09:18:57.579046 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-a0740199-bfc4-4493-bef7-dce20f322202 req-f3d56dd7-cdae-4c5c-a59f-4abee33e045d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071424 Aug 02 09:18:57.580107 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 486/943] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:18:57.860618 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-ecce475e-e326-4a9f-9ed9-5001f30c9b11 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:57.861669 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-ecce475e-e326-4a9f-9ed9-5001f30c9b11 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: 00edf329-01da-482b-b5ab-476ec4f3ba74] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:57.876907 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ecce475e-e326-4a9f-9ed9-5001f30c9b11 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:57.876907 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ecce475e-e326-4a9f-9ed9-5001f30c9b11 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:57.876907 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ecce475e-e326-4a9f-9ed9-5001f30c9b11 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:57.876907 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ecce475e-e326-4a9f-9ed9-5001f30c9b11 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:58.065892 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-ecce475e-e326-4a9f-9ed9-5001f30c9b11 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:58.075865 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-ecce475e-e326-4a9f-9ed9-5001f30c9b11 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74" status: 200 len: 1314 microversion: 2.1 time: 0.219924 Aug 02 09:18:58.076640 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 458/944] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:57 2022] GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:18:59.101221 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-c17951ce-44c4-408d-b464-1113469f7a16 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:18:59.101922 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-c17951ce-44c4-408d-b464-1113469f7a16 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: 00edf329-01da-482b-b5ab-476ec4f3ba74] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:18:59.111194 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c17951ce-44c4-408d-b464-1113469f7a16 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:59.111782 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c17951ce-44c4-408d-b464-1113469f7a16 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:59.112714 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c17951ce-44c4-408d-b464-1113469f7a16 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:18:59.113219 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c17951ce-44c4-408d-b464-1113469f7a16 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:18:59.298819 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-c17951ce-44c4-408d-b464-1113469f7a16 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:18:59.308142 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-c17951ce-44c4-408d-b464-1113469f7a16 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74" status: 200 len: 1314 microversion: 2.1 time: 0.212462 Aug 02 09:18:59.308587 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 487/945] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:18:59 2022] GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:00.334902 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-0bd0bbd4-7cd4-457f-937a-c8de6df166cf tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:00.341032 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-0bd0bbd4-7cd4-457f-937a-c8de6df166cf tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: 00edf329-01da-482b-b5ab-476ec4f3ba74] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:00.383637 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0bd0bbd4-7cd4-457f-937a-c8de6df166cf tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:00.383637 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0bd0bbd4-7cd4-457f-937a-c8de6df166cf tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:00.383637 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0bd0bbd4-7cd4-457f-937a-c8de6df166cf tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:00.383637 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0bd0bbd4-7cd4-457f-937a-c8de6df166cf tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:00.393673 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:00.600408 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-0bd0bbd4-7cd4-457f-937a-c8de6df166cf tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:00.613316 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-0bd0bbd4-7cd4-457f-937a-c8de6df166cf tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74" status: 200 len: 1314 microversion: 2.1 time: 0.285061 Aug 02 09:19:00.615150 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 459/946] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:00 2022] GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:01.647071 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ba70b05c-67ce-45c0-ac2e-0df2a84dbcee tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:01.647071 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ba70b05c-67ce-45c0-ac2e-0df2a84dbcee tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: 00edf329-01da-482b-b5ab-476ec4f3ba74] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:01.651279 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=2 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:01.651279 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=6 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:01.658126 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ba70b05c-67ce-45c0-ac2e-0df2a84dbcee tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:01.663882 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ba70b05c-67ce-45c0-ac2e-0df2a84dbcee tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:01.663882 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ba70b05c-67ce-45c0-ac2e-0df2a84dbcee tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:01.663882 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ba70b05c-67ce-45c0-ac2e-0df2a84dbcee tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:01.854465 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ba70b05c-67ce-45c0-ac2e-0df2a84dbcee tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:01.866162 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ba70b05c-67ce-45c0-ac2e-0df2a84dbcee tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74" status: 200 len: 1314 microversion: 2.1 time: 0.224966 Aug 02 09:19:01.867567 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 488/947] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:01 2022] GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:02.893601 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-72bd874a-7cdb-4b19-ab22-a6a799e026c5 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:02.894663 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-72bd874a-7cdb-4b19-ab22-a6a799e026c5 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: 00edf329-01da-482b-b5ab-476ec4f3ba74] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:02.898453 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=2 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:02.922775 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-72bd874a-7cdb-4b19-ab22-a6a799e026c5 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:02.924872 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-72bd874a-7cdb-4b19-ab22-a6a799e026c5 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:02.926723 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-72bd874a-7cdb-4b19-ab22-a6a799e026c5 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:02.928951 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-72bd874a-7cdb-4b19-ab22-a6a799e026c5 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:03.149160 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-72bd874a-7cdb-4b19-ab22-a6a799e026c5 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:03.156925 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-72bd874a-7cdb-4b19-ab22-a6a799e026c5 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74" status: 200 len: 1314 microversion: 2.1 time: 0.270103 Aug 02 09:19:03.157489 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 460/948] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:02 2022] GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:04.183096 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-57fd5441-04de-4a4c-bbd2-2b2bbec40ef9 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:04.184348 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-57fd5441-04de-4a4c-bbd2-2b2bbec40ef9 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: 00edf329-01da-482b-b5ab-476ec4f3ba74] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:04.196821 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-57fd5441-04de-4a4c-bbd2-2b2bbec40ef9 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:04.197500 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-57fd5441-04de-4a4c-bbd2-2b2bbec40ef9 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:04.198465 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-57fd5441-04de-4a4c-bbd2-2b2bbec40ef9 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:04.198992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-57fd5441-04de-4a4c-bbd2-2b2bbec40ef9 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:04.215736 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-89b540af-326d-4c94-87b5-fb549d1158cb req-c34e16cd-47ef-4f4a-8ae9-0442db75a9be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00edf329-01da-482b-b5ab-476ec4f3ba74", "name": "network-vif-plugged", "status": "completed", "tag": "4245fb4e-a860-4b04-9fba-526102830ad4"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:19:04.228588 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-89b540af-326d-4c94-87b5-fb549d1158cb req-c34e16cd-47ef-4f4a-8ae9-0442db75a9be service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:04.229275 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-89b540af-326d-4c94-87b5-fb549d1158cb req-c34e16cd-47ef-4f4a-8ae9-0442db75a9be service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:04.244494 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-89b540af-326d-4c94-87b5-fb549d1158cb req-c34e16cd-47ef-4f4a-8ae9-0442db75a9be service nova] Creating event network-vif-plugged:4245fb4e-a860-4b04-9fba-526102830ad4 for instance 00edf329-01da-482b-b5ab-476ec4f3ba74 on hv-cinder-84599 Aug 02 09:19:04.250233 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-89b540af-326d-4c94-87b5-fb549d1158cb req-c34e16cd-47ef-4f4a-8ae9-0442db75a9be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038719 Aug 02 09:19:04.250910 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 461/949] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:04.402917 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-57fd5441-04de-4a4c-bbd2-2b2bbec40ef9 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:04.415490 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-57fd5441-04de-4a4c-bbd2-2b2bbec40ef9 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74" status: 200 len: 1314 microversion: 2.1 time: 0.240251 Aug 02 09:19:04.417404 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 489/950] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:04 2022] GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:05.450920 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a5b5cb79-248d-44f8-9cc4-8e2b2f0bd2f3 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:05.451698 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-a5b5cb79-248d-44f8-9cc4-8e2b2f0bd2f3 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: 00edf329-01da-482b-b5ab-476ec4f3ba74] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:05.459336 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a5b5cb79-248d-44f8-9cc4-8e2b2f0bd2f3 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:05.460025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a5b5cb79-248d-44f8-9cc4-8e2b2f0bd2f3 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:05.460836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a5b5cb79-248d-44f8-9cc4-8e2b2f0bd2f3 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:05.461357 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a5b5cb79-248d-44f8-9cc4-8e2b2f0bd2f3 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:05.655694 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-a5b5cb79-248d-44f8-9cc4-8e2b2f0bd2f3 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:05.669834 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-a5b5cb79-248d-44f8-9cc4-8e2b2f0bd2f3 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74" status: 200 len: 1314 microversion: 2.1 time: 0.222769 Aug 02 09:19:05.671200 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 462/951] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:05 2022] GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:06.693970 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-8143ae6d-5af1-42ea-8198-f48d2c39907e tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:06.694577 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-8143ae6d-5af1-42ea-8198-f48d2c39907e tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: 00edf329-01da-482b-b5ab-476ec4f3ba74] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:06.703283 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8143ae6d-5af1-42ea-8198-f48d2c39907e tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:06.703733 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8143ae6d-5af1-42ea-8198-f48d2c39907e tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:06.704708 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8143ae6d-5af1-42ea-8198-f48d2c39907e tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:06.705119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8143ae6d-5af1-42ea-8198-f48d2c39907e tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:06.874821 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-8143ae6d-5af1-42ea-8198-f48d2c39907e tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:06.882949 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-8143ae6d-5af1-42ea-8198-f48d2c39907e tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74" status: 200 len: 1498 microversion: 2.1 time: 0.193630 Aug 02 09:19:06.883685 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 490/952] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:06 2022] GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74 => generated 1498 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:07.971116 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-68594e49-192d-48d2-a4ff-9496162a3ee5 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:07.972661 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-68594e49-192d-48d2-a4ff-9496162a3ee5 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: 00edf329-01da-482b-b5ab-476ec4f3ba74] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:07.980677 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-68594e49-192d-48d2-a4ff-9496162a3ee5 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:07.981130 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-68594e49-192d-48d2-a4ff-9496162a3ee5 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:07.981919 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-68594e49-192d-48d2-a4ff-9496162a3ee5 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:07.982352 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-68594e49-192d-48d2-a4ff-9496162a3ee5 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:08.010304 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-68594e49-192d-48d2-a4ff-9496162a3ee5 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: 00edf329-01da-482b-b5ab-476ec4f3ba74] Going to try to terminate instance {{(pid=118526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:19:08.454944 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-68594e49-192d-48d2-a4ff-9496162a3ee5 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "DELETE /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74" status: 204 len: 0 microversion: 2.1 time: 0.491208 Aug 02 09:19:08.455647 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 463/953] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:19:07 2022] DELETE /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:19:08.465740 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-831b7b7d-594d-48c9-a980-de8f790841c7 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:08.466348 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-831b7b7d-594d-48c9-a980-de8f790841c7 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: 00edf329-01da-482b-b5ab-476ec4f3ba74] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:08.477842 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-831b7b7d-594d-48c9-a980-de8f790841c7 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:08.477842 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-831b7b7d-594d-48c9-a980-de8f790841c7 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:08.478615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-831b7b7d-594d-48c9-a980-de8f790841c7 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:08.479243 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-831b7b7d-594d-48c9-a980-de8f790841c7 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:08.647612 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-831b7b7d-594d-48c9-a980-de8f790841c7 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:08.658251 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-831b7b7d-594d-48c9-a980-de8f790841c7 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74" status: 200 len: 1504 microversion: 2.1 time: 0.196029 Aug 02 09:19:08.660130 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 491/954] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:08 2022] GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74 => generated 1504 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:09.683128 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b995e889-eb0c-476c-ae7f-0152d124b273 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:09.683828 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b995e889-eb0c-476c-ae7f-0152d124b273 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: 00edf329-01da-482b-b5ab-476ec4f3ba74] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:09.691165 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b995e889-eb0c-476c-ae7f-0152d124b273 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:09.691646 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b995e889-eb0c-476c-ae7f-0152d124b273 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:09.693248 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b995e889-eb0c-476c-ae7f-0152d124b273 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:09.693931 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b995e889-eb0c-476c-ae7f-0152d124b273 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:09.850415 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b995e889-eb0c-476c-ae7f-0152d124b273 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:09.858860 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b995e889-eb0c-476c-ae7f-0152d124b273 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74" status: 200 len: 1504 microversion: 2.1 time: 0.180529 Aug 02 09:19:09.859654 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 464/955] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:09 2022] GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74 => generated 1504 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:10.737872 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-4fc3ad8f-a9e0-4b32-883d-de51640f21f2 req-e41105db-4fe4-4c7b-8028-4ffd0e6dcdaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "00edf329-01da-482b-b5ab-476ec4f3ba74", "name": "network-vif-deleted", "tag": "4245fb4e-a860-4b04-9fba-526102830ad4"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:19:10.752416 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-4fc3ad8f-a9e0-4b32-883d-de51640f21f2 req-e41105db-4fe4-4c7b-8028-4ffd0e6dcdaf service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:10.752782 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-4fc3ad8f-a9e0-4b32-883d-de51640f21f2 req-e41105db-4fe4-4c7b-8028-4ffd0e6dcdaf service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:10.766704 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-4fc3ad8f-a9e0-4b32-883d-de51640f21f2 req-e41105db-4fe4-4c7b-8028-4ffd0e6dcdaf service nova] Creating event network-vif-deleted:4245fb4e-a860-4b04-9fba-526102830ad4 for instance 00edf329-01da-482b-b5ab-476ec4f3ba74 on hv-cinder-84599 Aug 02 09:19:10.775376 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-4fc3ad8f-a9e0-4b32-883d-de51640f21f2 req-e41105db-4fe4-4c7b-8028-4ffd0e6dcdaf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044226 Aug 02 09:19:10.775376 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 492/956] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:10.882230 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-75700fed-65d4-4abc-be53-b16d1db97a16 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:10.882859 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-75700fed-65d4-4abc-be53-b16d1db97a16 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: 00edf329-01da-482b-b5ab-476ec4f3ba74] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:10.890054 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-75700fed-65d4-4abc-be53-b16d1db97a16 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:10.890520 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-75700fed-65d4-4abc-be53-b16d1db97a16 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:10.891539 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-75700fed-65d4-4abc-be53-b16d1db97a16 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:10.891793 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-75700fed-65d4-4abc-be53-b16d1db97a16 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:10.966841 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-75700fed-65d4-4abc-be53-b16d1db97a16 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cd2f7ae47fd42929ccfaed668c5a55f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f15f389a69d249adaa55b25d60e54ab0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:10.975642 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-75700fed-65d4-4abc-be53-b16d1db97a16 tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74" status: 200 len: 1462 microversion: 2.1 time: 0.097998 Aug 02 09:19:10.976269 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 465/957] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:10 2022] GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74 => generated 1462 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:12.003615 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-2fb8a36a-627a-49e4-91bf-fbbd7ececaed tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:12.004339 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-2fb8a36a-627a-49e4-91bf-fbbd7ececaed tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] [instance: 00edf329-01da-482b-b5ab-476ec4f3ba74] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:12.015218 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2fb8a36a-627a-49e4-91bf-fbbd7ececaed tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:12.015675 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2fb8a36a-627a-49e4-91bf-fbbd7ececaed tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:12.016540 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2fb8a36a-627a-49e4-91bf-fbbd7ececaed tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:12.016978 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2fb8a36a-627a-49e4-91bf-fbbd7ececaed tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:12.033829 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-2fb8a36a-627a-49e4-91bf-fbbd7ececaed tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] HTTP exception thrown: Instance 00edf329-01da-482b-b5ab-476ec4f3ba74 could not be found. Aug 02 09:19:12.037529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-2fb8a36a-627a-49e4-91bf-fbbd7ececaed tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Request method failure captured: Aug 02 09:19:12.037529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74 HTTP/1.1 Aug 02 09:19:12.037529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:19:12.037529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:19:12.037529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:19:12.037529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:19:12.037529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:19:12.037529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:19:12.037529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:19:12.037529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:19:12.037529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6OvX40u4gQBfCQVVWxh0CauGdAD30PsNW6hEWAjY8pduSIj7VMBmei1mx53DCAB9fupJntkgwRQmShPkHPLeZHzelsP7w1LoJuXN5aChkNoM0Gs2OuY_ITrTrimwYMWIBDxPLlzNY3MDGGOuaniDo_ElXvzReglOs2bZHVcoqmskcsM Aug 02 09:19:12.037529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:19:12.037529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:19:12.037529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:19:12.037529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:19:12.037529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:19:12.037529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:19:12.037529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: f15f389a69d249adaa55b25d60e54ab0 Aug 02 09:19:12.037529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-VolumesActionsTest-420312351 Aug 02 09:19:12.037529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:19:12.037529 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:19:12.042086 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f15f389a69d249adaa55b25d60e54ab0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f15f389a69d249adaa55b25d60e54ab0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f15f389a69d249adaa55b25d60e54ab0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f15f389a69d249adaa55b25d60e54ab0"}]}] Aug 02 09:19:12.042086 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-VolumesActionsTest-420312351 Aug 02 09:19:12.042086 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: f15f389a69d249adaa55b25d60e54ab0 Aug 02 09:19:12.042086 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-VolumesActionsTest-420312351 Aug 02 09:19:12.042086 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-VolumesActionsTest-420312351-project Aug 02 09:19:12.042086 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:19:12.042086 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:19:12.042086 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: 6cd2f7ae47fd42929ccfaed668c5a55f Aug 02 09:19:12.042086 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-VolumesActionsTest-420312351-project Aug 02 09:19:12.042086 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: > Aug 02 09:19:12.042086 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Instance 00edf329-01da-482b-b5ab-476ec4f3ba74 could not be found. Aug 02 09:19:12.042086 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': '00edf329-01da-482b-b5ab-476ec4f3ba74'} Aug 02 09:19:12.043360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:19:12.043360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:19:12.043360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:19:12.043360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:19:12.043360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:19:12.043360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:19:12.043360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:19:12.043360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:19:12.043360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:19:12.043360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:19:12.043360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 00edf329-01da-482b-b5ab-476ec4f3ba74 could not be found. Aug 02 09:19:12.043360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:19:12.043360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:19:12.043360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:19:12.043360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:19:12.043360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:19:12.043360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:19:12.043360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:19:12.043360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:19:12.043360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:19:12.044616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:19:12.044616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:19:12.044616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:19:12.044616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:19:12.044616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:19:12.044616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:19:12.044616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:19:12.044616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 00edf329-01da-482b-b5ab-476ec4f3ba74 could not be found. Aug 02 09:19:12.044616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:19:12.044616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:19:12.044616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:19:12.044616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:19:12.044616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:19:12.044616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:19:12.044616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:19:12.044616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:19:12.044616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 00edf329-01da-482b-b5ab-476ec4f3ba74 could not be found. Aug 02 09:19:12.044616 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:19:12.045712 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-2fb8a36a-627a-49e4-91bf-fbbd7ececaed tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] Returning 404 to user: Instance 00edf329-01da-482b-b5ab-476ec4f3ba74 could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:19:12.045712 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-2fb8a36a-627a-49e4-91bf-fbbd7ececaed tempest-VolumesActionsTest-420312351 tempest-VolumesActionsTest-420312351-project] 10.222.0.20 "GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74" status: 404 len: 111 microversion: 2.1 time: 0.037994 Aug 02 09:19:12.045712 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 493/958] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:11 2022] GET /compute/v2.1/servers/00edf329-01da-482b-b5ab-476ec4f3ba74 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:19:33.186250 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-aaa0703f-22bd-4b9f-93e8-732a9d8d0084 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1630259829", "imageRef": "7a52f4c5-c531-494a-b375-4f6dce3abbc2", "flavorRef": "452"}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:19:33.195395 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:33.196085 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:33.284835 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.network.neutron [None req-aaa0703f-22bd-4b9f-93e8-732a9d8d0084 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] validate_networks() for None {{(pid=118526) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:19:33.721704 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-aaa0703f-22bd-4b9f-93e8-732a9d8d0084 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Flavor limits 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:19:33.722587 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-aaa0703f-22bd-4b9f-93e8-732a9d8d0084 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Image limits 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:19:33.723069 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-aaa0703f-22bd-4b9f-93e8-732a9d8d0084 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Flavor pref 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:19:33.723594 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-aaa0703f-22bd-4b9f-93e8-732a9d8d0084 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Image pref 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:19:33.724221 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-aaa0703f-22bd-4b9f-93e8-732a9d8d0084 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:19:33.752348 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-aaa0703f-22bd-4b9f-93e8-732a9d8d0084 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:33.753223 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-aaa0703f-22bd-4b9f-93e8-732a9d8d0084 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:33.754192 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-aaa0703f-22bd-4b9f-93e8-732a9d8d0084 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:33.755794 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-aaa0703f-22bd-4b9f-93e8-732a9d8d0084 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:33.776282 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-aaa0703f-22bd-4b9f-93e8-732a9d8d0084 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Getting quotas for project d161d2feb00e4986902d6fa841f0ca59. Resources: {'cores', 'ram', 'instances'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:19:33.785914 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-aaa0703f-22bd-4b9f-93e8-732a9d8d0084 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Getting quotas for user 8636edba3b8a4d8ca7843b7d882300c0 and project d161d2feb00e4986902d6fa841f0ca59. Resources: {'cores', 'ram', 'instances'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:19:33.803698 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-aaa0703f-22bd-4b9f-93e8-732a9d8d0084 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Going to run 1 instances... {{(pid=118526) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:19:33.808221 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-aaa0703f-22bd-4b9f-93e8-732a9d8d0084 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] [instance: ffe67fde-94fd-494e-a62f-cf488fdec9ae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7a52f4c5-c531-494a-b375-4f6dce3abbc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:19:33.975125 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-aaa0703f-22bd-4b9f-93e8-732a9d8d0084 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793593 Aug 02 09:19:33.976033 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 466/959] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 2 09:19:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 09:19:33.989775 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-c3ec7740-c841-490e-8597-dc677caeb307 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:33.990667 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-c3ec7740-c841-490e-8597-dc677caeb307 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] [instance: ffe67fde-94fd-494e-a62f-cf488fdec9ae] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:34.007620 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:34.014627 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=57 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:34.110435 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-c3ec7740-c841-490e-8597-dc677caeb307 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8636edba3b8a4d8ca7843b7d882300c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd161d2feb00e4986902d6fa841f0ca59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:34.127176 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-c3ec7740-c841-490e-8597-dc677caeb307 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae" status: 200 len: 1215 microversion: 2.1 time: 0.141431 Aug 02 09:19:34.128485 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 494/960] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:33 2022] GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae => generated 1215 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:35.153526 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-2746d727-9fed-4181-b19b-80ef49a04fff tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:35.154283 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-2746d727-9fed-4181-b19b-80ef49a04fff tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] [instance: ffe67fde-94fd-494e-a62f-cf488fdec9ae] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:35.228353 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-2746d727-9fed-4181-b19b-80ef49a04fff tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8636edba3b8a4d8ca7843b7d882300c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd161d2feb00e4986902d6fa841f0ca59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:35.237300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-2746d727-9fed-4181-b19b-80ef49a04fff tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae" status: 200 len: 1215 microversion: 2.1 time: 0.090041 Aug 02 09:19:35.238303 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 467/961] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:35 2022] GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae => generated 1215 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:36.266392 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-cd2a0180-0051-456f-98e3-19b0216174f7 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:36.267360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-cd2a0180-0051-456f-98e3-19b0216174f7 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] [instance: ffe67fde-94fd-494e-a62f-cf488fdec9ae] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:36.297122 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cd2a0180-0051-456f-98e3-19b0216174f7 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:36.297970 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cd2a0180-0051-456f-98e3-19b0216174f7 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:36.300430 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cd2a0180-0051-456f-98e3-19b0216174f7 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:36.301246 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cd2a0180-0051-456f-98e3-19b0216174f7 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:36.394104 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-cd2a0180-0051-456f-98e3-19b0216174f7 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8636edba3b8a4d8ca7843b7d882300c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd161d2feb00e4986902d6fa841f0ca59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:36.407611 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-cd2a0180-0051-456f-98e3-19b0216174f7 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae" status: 200 len: 1219 microversion: 2.1 time: 0.147939 Aug 02 09:19:36.416604 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 495/962] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:36 2022] GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:37.436006 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-028f9faf-d0a2-499a-bb0d-b9c2092b3e0c tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:37.436663 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-028f9faf-d0a2-499a-bb0d-b9c2092b3e0c tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] [instance: ffe67fde-94fd-494e-a62f-cf488fdec9ae] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:37.468906 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-028f9faf-d0a2-499a-bb0d-b9c2092b3e0c tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:37.469513 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-028f9faf-d0a2-499a-bb0d-b9c2092b3e0c tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:37.470381 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-028f9faf-d0a2-499a-bb0d-b9c2092b3e0c tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:37.472577 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-028f9faf-d0a2-499a-bb0d-b9c2092b3e0c tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:37.613675 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-028f9faf-d0a2-499a-bb0d-b9c2092b3e0c tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8636edba3b8a4d8ca7843b7d882300c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd161d2feb00e4986902d6fa841f0ca59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:37.643263 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-028f9faf-d0a2-499a-bb0d-b9c2092b3e0c tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae" status: 200 len: 1275 microversion: 2.1 time: 0.208830 Aug 02 09:19:37.646332 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 468/963] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:37 2022] GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae => generated 1275 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:38.673090 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-76c629e6-1518-4191-91cb-7ef3d83f0e35 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:38.673715 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-76c629e6-1518-4191-91cb-7ef3d83f0e35 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] [instance: ffe67fde-94fd-494e-a62f-cf488fdec9ae] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:38.681632 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-76c629e6-1518-4191-91cb-7ef3d83f0e35 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:38.682097 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-76c629e6-1518-4191-91cb-7ef3d83f0e35 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:38.683478 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-76c629e6-1518-4191-91cb-7ef3d83f0e35 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:38.684119 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-76c629e6-1518-4191-91cb-7ef3d83f0e35 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:38.794339 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-76c629e6-1518-4191-91cb-7ef3d83f0e35 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8636edba3b8a4d8ca7843b7d882300c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd161d2feb00e4986902d6fa841f0ca59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:38.805733 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-76c629e6-1518-4191-91cb-7ef3d83f0e35 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae" status: 200 len: 1273 microversion: 2.1 time: 0.136752 Aug 02 09:19:38.820097 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 496/964] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:38 2022] GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae => generated 1273 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:39.831636 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-d977175f-78ad-4086-86a6-9fbbebd2d7cb tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:39.832381 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-d977175f-78ad-4086-86a6-9fbbebd2d7cb tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] [instance: ffe67fde-94fd-494e-a62f-cf488fdec9ae] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:39.841601 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d977175f-78ad-4086-86a6-9fbbebd2d7cb tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:39.843070 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d977175f-78ad-4086-86a6-9fbbebd2d7cb tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:39.844091 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d977175f-78ad-4086-86a6-9fbbebd2d7cb tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:39.844649 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d977175f-78ad-4086-86a6-9fbbebd2d7cb tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:40.120013 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-d977175f-78ad-4086-86a6-9fbbebd2d7cb tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8636edba3b8a4d8ca7843b7d882300c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd161d2feb00e4986902d6fa841f0ca59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:40.134475 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-d977175f-78ad-4086-86a6-9fbbebd2d7cb tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae" status: 200 len: 1315 microversion: 2.1 time: 0.306298 Aug 02 09:19:40.136337 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 469/965] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:39 2022] GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:40.773157 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-26f94fa4-d98c-427c-a864-fbdec84a626e req-a4adf6c3-0bb2-447e-beb0-ff892b9aee16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffe67fde-94fd-494e-a62f-cf488fdec9ae", "tag": "03d0ebe1-0402-4802-a135-a5c51cb1b553"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:19:40.788728 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-26f94fa4-d98c-427c-a864-fbdec84a626e req-a4adf6c3-0bb2-447e-beb0-ff892b9aee16 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:40.788728 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-26f94fa4-d98c-427c-a864-fbdec84a626e req-a4adf6c3-0bb2-447e-beb0-ff892b9aee16 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:40.797767 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-26f94fa4-d98c-427c-a864-fbdec84a626e req-a4adf6c3-0bb2-447e-beb0-ff892b9aee16 service nova] Creating event network-changed:03d0ebe1-0402-4802-a135-a5c51cb1b553 for instance ffe67fde-94fd-494e-a62f-cf488fdec9ae on hv-cinder-84599 Aug 02 09:19:40.803728 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-26f94fa4-d98c-427c-a864-fbdec84a626e req-a4adf6c3-0bb2-447e-beb0-ff892b9aee16 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034539 Aug 02 09:19:40.804732 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 497/966] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:41.158759 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-3a578f6b-7a3b-4c43-9e96-7ebe5edc0d4c tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:41.159442 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-3a578f6b-7a3b-4c43-9e96-7ebe5edc0d4c tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] [instance: ffe67fde-94fd-494e-a62f-cf488fdec9ae] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:41.168415 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3a578f6b-7a3b-4c43-9e96-7ebe5edc0d4c tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:41.168656 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3a578f6b-7a3b-4c43-9e96-7ebe5edc0d4c tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:41.169521 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3a578f6b-7a3b-4c43-9e96-7ebe5edc0d4c tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:41.170038 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3a578f6b-7a3b-4c43-9e96-7ebe5edc0d4c tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:41.416512 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-3a578f6b-7a3b-4c43-9e96-7ebe5edc0d4c tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8636edba3b8a4d8ca7843b7d882300c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd161d2feb00e4986902d6fa841f0ca59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:41.424373 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-3a578f6b-7a3b-4c43-9e96-7ebe5edc0d4c tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae" status: 200 len: 1315 microversion: 2.1 time: 0.270774 Aug 02 09:19:41.425029 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 470/967] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:41 2022] GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:42.447664 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-089f335f-c5a8-49b6-be20-e0b1d5d00f8a tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:42.448437 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-089f335f-c5a8-49b6-be20-e0b1d5d00f8a tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] [instance: ffe67fde-94fd-494e-a62f-cf488fdec9ae] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:42.455612 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-089f335f-c5a8-49b6-be20-e0b1d5d00f8a tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:42.456077 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-089f335f-c5a8-49b6-be20-e0b1d5d00f8a tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:42.456952 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-089f335f-c5a8-49b6-be20-e0b1d5d00f8a tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:42.457381 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-089f335f-c5a8-49b6-be20-e0b1d5d00f8a tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:42.603494 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-089f335f-c5a8-49b6-be20-e0b1d5d00f8a tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8636edba3b8a4d8ca7843b7d882300c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd161d2feb00e4986902d6fa841f0ca59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:42.611187 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-089f335f-c5a8-49b6-be20-e0b1d5d00f8a tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae" status: 200 len: 1315 microversion: 2.1 time: 0.168607 Aug 02 09:19:42.611763 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 498/968] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:42 2022] GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:43.633075 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-06fb1b8d-c367-4420-8327-92908c70cb37 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:43.633853 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-06fb1b8d-c367-4420-8327-92908c70cb37 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] [instance: ffe67fde-94fd-494e-a62f-cf488fdec9ae] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:43.640627 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-06fb1b8d-c367-4420-8327-92908c70cb37 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:43.641074 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-06fb1b8d-c367-4420-8327-92908c70cb37 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:43.641858 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-06fb1b8d-c367-4420-8327-92908c70cb37 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:43.642289 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-06fb1b8d-c367-4420-8327-92908c70cb37 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:43.763401 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=2 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:43.818129 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-06fb1b8d-c367-4420-8327-92908c70cb37 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8636edba3b8a4d8ca7843b7d882300c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd161d2feb00e4986902d6fa841f0ca59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:43.826494 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-06fb1b8d-c367-4420-8327-92908c70cb37 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae" status: 200 len: 1315 microversion: 2.1 time: 0.197929 Aug 02 09:19:43.827394 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 471/969] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:43 2022] GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:44.858045 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-1b98d7f9-2d1f-4c4b-8208-ab0d0bedcc44 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:44.859970 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-1b98d7f9-2d1f-4c4b-8208-ab0d0bedcc44 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] [instance: ffe67fde-94fd-494e-a62f-cf488fdec9ae] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:44.872921 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=2 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:44.872921 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1b98d7f9-2d1f-4c4b-8208-ab0d0bedcc44 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:44.872921 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1b98d7f9-2d1f-4c4b-8208-ab0d0bedcc44 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:44.872921 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1b98d7f9-2d1f-4c4b-8208-ab0d0bedcc44 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:44.873297 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1b98d7f9-2d1f-4c4b-8208-ab0d0bedcc44 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:45.011068 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-1b98d7f9-2d1f-4c4b-8208-ab0d0bedcc44 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8636edba3b8a4d8ca7843b7d882300c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd161d2feb00e4986902d6fa841f0ca59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:45.018698 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-1b98d7f9-2d1f-4c4b-8208-ab0d0bedcc44 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae" status: 200 len: 1315 microversion: 2.1 time: 0.170844 Aug 02 09:19:45.019263 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 499/970] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:44 2022] GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:46.041762 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-7aa3e375-c930-4598-8128-81fea852c7f0 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:46.042498 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-7aa3e375-c930-4598-8128-81fea852c7f0 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] [instance: ffe67fde-94fd-494e-a62f-cf488fdec9ae] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:46.045344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=8 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:46.051843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7aa3e375-c930-4598-8128-81fea852c7f0 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:46.054050 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7aa3e375-c930-4598-8128-81fea852c7f0 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:46.054050 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7aa3e375-c930-4598-8128-81fea852c7f0 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:46.054050 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7aa3e375-c930-4598-8128-81fea852c7f0 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:46.189522 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-7aa3e375-c930-4598-8128-81fea852c7f0 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8636edba3b8a4d8ca7843b7d882300c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd161d2feb00e4986902d6fa841f0ca59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:46.198683 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-7aa3e375-c930-4598-8128-81fea852c7f0 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae" status: 200 len: 1315 microversion: 2.1 time: 0.161006 Aug 02 09:19:46.199274 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 472/971] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:46 2022] GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:46.831532 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-3d2e6c91-c67b-44bc-8877-f9facd8fb22e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-941920135", "imageRef": "7a52f4c5-c531-494a-b375-4f6dce3abbc2", "flavorRef": "452", "networks": [{"uuid": "aa294ec1-7c45-49c8-9019-eccbb87d89fd"}]}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:19:46.892625 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.network.neutron [None req-3d2e6c91-c67b-44bc-8877-f9facd8fb22e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] validate_networks() for [('aa294ec1-7c45-49c8-9019-eccbb87d89fd', None, None, None, None, None)] {{(pid=118525) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:19:47.221624 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-0dc2c25e-2b42-49ec-ba3a-5d62d7422639 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:47.221624 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-0dc2c25e-2b42-49ec-ba3a-5d62d7422639 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] [instance: ffe67fde-94fd-494e-a62f-cf488fdec9ae] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:47.229135 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0dc2c25e-2b42-49ec-ba3a-5d62d7422639 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:47.229859 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0dc2c25e-2b42-49ec-ba3a-5d62d7422639 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:47.230676 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0dc2c25e-2b42-49ec-ba3a-5d62d7422639 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:47.231347 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0dc2c25e-2b42-49ec-ba3a-5d62d7422639 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:47.383624 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-3d2e6c91-c67b-44bc-8877-f9facd8fb22e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Flavor limits 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:19:47.384431 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-3d2e6c91-c67b-44bc-8877-f9facd8fb22e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Image limits 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:19:47.385273 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-3d2e6c91-c67b-44bc-8877-f9facd8fb22e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Flavor pref 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:19:47.385849 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-3d2e6c91-c67b-44bc-8877-f9facd8fb22e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Image pref 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:19:47.386414 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-3d2e6c91-c67b-44bc-8877-f9facd8fb22e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:19:47.397421 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3d2e6c91-c67b-44bc-8877-f9facd8fb22e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:47.398194 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3d2e6c91-c67b-44bc-8877-f9facd8fb22e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:47.399429 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3d2e6c91-c67b-44bc-8877-f9facd8fb22e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:47.399930 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3d2e6c91-c67b-44bc-8877-f9facd8fb22e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:47.417568 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-0dc2c25e-2b42-49ec-ba3a-5d62d7422639 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8636edba3b8a4d8ca7843b7d882300c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd161d2feb00e4986902d6fa841f0ca59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:47.428112 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-0dc2c25e-2b42-49ec-ba3a-5d62d7422639 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae" status: 200 len: 1315 microversion: 2.1 time: 0.211581 Aug 02 09:19:47.428378 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-3d2e6c91-c67b-44bc-8877-f9facd8fb22e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Getting quotas for project 533a6226184d43a5b13c9da2c4a5d971. Resources: {'cores', 'ram', 'instances'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:19:47.433676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-3d2e6c91-c67b-44bc-8877-f9facd8fb22e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Getting quotas for user a6a74b4d273744a1bad7637f6c7c6e23 and project 533a6226184d43a5b13c9da2c4a5d971. Resources: {'cores', 'ram', 'instances'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:19:47.441220 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 473/972] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:47 2022] GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:47.456415 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-3d2e6c91-c67b-44bc-8877-f9facd8fb22e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Going to run 1 instances... {{(pid=118525) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:19:47.460859 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-3d2e6c91-c67b-44bc-8877-f9facd8fb22e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7a52f4c5-c531-494a-b375-4f6dce3abbc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118525) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:19:47.495250 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-5a10b4a4-fee8-481e-9d6b-2de669021119 req-849c1877-d976-4e98-8a1b-dbc2af03a6c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe67fde-94fd-494e-a62f-cf488fdec9ae", "name": "network-vif-plugged", "status": "completed", "tag": "03d0ebe1-0402-4802-a135-a5c51cb1b553"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:19:47.512224 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-5a10b4a4-fee8-481e-9d6b-2de669021119 req-849c1877-d976-4e98-8a1b-dbc2af03a6c7 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:47.512672 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-5a10b4a4-fee8-481e-9d6b-2de669021119 req-849c1877-d976-4e98-8a1b-dbc2af03a6c7 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:47.527470 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-5a10b4a4-fee8-481e-9d6b-2de669021119 req-849c1877-d976-4e98-8a1b-dbc2af03a6c7 service nova] Creating event network-vif-plugged:03d0ebe1-0402-4802-a135-a5c51cb1b553 for instance ffe67fde-94fd-494e-a62f-cf488fdec9ae on hv-cinder-84599 Aug 02 09:19:47.533555 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-5a10b4a4-fee8-481e-9d6b-2de669021119 req-849c1877-d976-4e98-8a1b-dbc2af03a6c7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043082 Aug 02 09:19:47.534845 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 474/973] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:47.626365 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-3d2e6c91-c67b-44bc-8877-f9facd8fb22e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.798646 Aug 02 09:19:47.627654 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 500/974] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 2 09:19:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:19:47.655325 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-481c36c1-e413-4ef6-ad71-adc24c2b75e5 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:47.657456 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-481c36c1-e413-4ef6-ad71-adc24c2b75e5 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:47.797898 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-481c36c1-e413-4ef6-ad71-adc24c2b75e5 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:47.807625 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-481c36c1-e413-4ef6-ad71-adc24c2b75e5 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815" status: 200 len: 1218 microversion: 2.1 time: 0.166157 Aug 02 09:19:47.808618 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 475/975] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:47 2022] GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815 => generated 1218 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:48.456586 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-8892509c-bd69-4806-9dc4-d1de5ec9b12d tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:48.457451 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-8892509c-bd69-4806-9dc4-d1de5ec9b12d tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] [instance: ffe67fde-94fd-494e-a62f-cf488fdec9ae] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:48.468340 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8892509c-bd69-4806-9dc4-d1de5ec9b12d tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:48.468691 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8892509c-bd69-4806-9dc4-d1de5ec9b12d tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:48.469484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8892509c-bd69-4806-9dc4-d1de5ec9b12d tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:48.469931 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8892509c-bd69-4806-9dc4-d1de5ec9b12d tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:48.843666 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-cb29ed37-a8f3-4dc9-b096-3f276059938e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:48.844402 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-cb29ed37-a8f3-4dc9-b096-3f276059938e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:48.934737 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-8892509c-bd69-4806-9dc4-d1de5ec9b12d tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8636edba3b8a4d8ca7843b7d882300c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd161d2feb00e4986902d6fa841f0ca59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:48.940435 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-cb29ed37-a8f3-4dc9-b096-3f276059938e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:48.944498 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-8892509c-bd69-4806-9dc4-d1de5ec9b12d tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae" status: 200 len: 1315 microversion: 2.1 time: 0.495824 Aug 02 09:19:48.945021 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 501/976] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:48 2022] GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae => generated 1315 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:48.953602 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-cb29ed37-a8f3-4dc9-b096-3f276059938e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815" status: 200 len: 1218 microversion: 2.1 time: 0.114380 Aug 02 09:19:48.954449 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 476/977] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:48 2022] GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815 => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:49.968502 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-0b596735-5777-467a-a889-314753a02f08 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:49.969100 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-0b596735-5777-467a-a889-314753a02f08 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] [instance: ffe67fde-94fd-494e-a62f-cf488fdec9ae] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:49.976531 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0b596735-5777-467a-a889-314753a02f08 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:49.976921 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0b596735-5777-467a-a889-314753a02f08 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:49.977726 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0b596735-5777-467a-a889-314753a02f08 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:49.978165 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-0b596735-5777-467a-a889-314753a02f08 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:49.981978 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-f8bc4bca-e2f0-4187-9a09-a6e606de67c7 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:49.982714 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-f8bc4bca-e2f0-4187-9a09-a6e606de67c7 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:49.990757 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f8bc4bca-e2f0-4187-9a09-a6e606de67c7 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:49.994343 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f8bc4bca-e2f0-4187-9a09-a6e606de67c7 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:49.994343 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f8bc4bca-e2f0-4187-9a09-a6e606de67c7 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:49.994343 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-f8bc4bca-e2f0-4187-9a09-a6e606de67c7 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:50.072990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-f8bc4bca-e2f0-4187-9a09-a6e606de67c7 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:50.081362 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-f8bc4bca-e2f0-4187-9a09-a6e606de67c7 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815" status: 200 len: 1222 microversion: 2.1 time: 0.103119 Aug 02 09:19:50.081959 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 477/978] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:49 2022] GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815 => generated 1222 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:50.158181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-0b596735-5777-467a-a889-314753a02f08 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8636edba3b8a4d8ca7843b7d882300c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd161d2feb00e4986902d6fa841f0ca59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:50.168437 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-0b596735-5777-467a-a889-314753a02f08 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae" status: 200 len: 1315 microversion: 2.1 time: 0.203460 Aug 02 09:19:50.169297 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 502/979] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:49 2022] GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:51.104204 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-d87d3546-6948-4508-b226-36736fea472a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:51.104790 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-d87d3546-6948-4508-b226-36736fea472a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:51.111455 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d87d3546-6948-4508-b226-36736fea472a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:51.111906 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d87d3546-6948-4508-b226-36736fea472a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:51.112708 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d87d3546-6948-4508-b226-36736fea472a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:51.113150 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d87d3546-6948-4508-b226-36736fea472a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:51.182226 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-d87d3546-6948-4508-b226-36736fea472a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:51.189438 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-65a72bea-130b-4407-ad09-46eb99ff6a41 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:51.190276 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-65a72bea-130b-4407-ad09-46eb99ff6a41 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] [instance: ffe67fde-94fd-494e-a62f-cf488fdec9ae] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:51.190404 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-d87d3546-6948-4508-b226-36736fea472a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815" status: 200 len: 1222 microversion: 2.1 time: 0.090334 Aug 02 09:19:51.190926 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 478/980] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:51 2022] GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815 => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:51.198027 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-65a72bea-130b-4407-ad09-46eb99ff6a41 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:51.198476 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-65a72bea-130b-4407-ad09-46eb99ff6a41 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:51.199321 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-65a72bea-130b-4407-ad09-46eb99ff6a41 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:51.199758 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-65a72bea-130b-4407-ad09-46eb99ff6a41 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:51.343002 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-65a72bea-130b-4407-ad09-46eb99ff6a41 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8636edba3b8a4d8ca7843b7d882300c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd161d2feb00e4986902d6fa841f0ca59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:51.352338 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-65a72bea-130b-4407-ad09-46eb99ff6a41 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae" status: 200 len: 1315 microversion: 2.1 time: 0.166889 Aug 02 09:19:51.352982 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 503/981] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:51 2022] GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:52.213839 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-40f46e79-4fc7-440f-a747-35e1e02c0202 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:52.214659 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-40f46e79-4fc7-440f-a747-35e1e02c0202 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:52.221924 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-40f46e79-4fc7-440f-a747-35e1e02c0202 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:52.222402 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-40f46e79-4fc7-440f-a747-35e1e02c0202 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:52.223696 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-40f46e79-4fc7-440f-a747-35e1e02c0202 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:52.224129 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-40f46e79-4fc7-440f-a747-35e1e02c0202 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:52.291646 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-40f46e79-4fc7-440f-a747-35e1e02c0202 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:52.299533 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-40f46e79-4fc7-440f-a747-35e1e02c0202 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815" status: 200 len: 1270 microversion: 2.1 time: 0.089884 Aug 02 09:19:52.300115 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 479/982] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:52 2022] GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:52.375563 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-7ce19578-e5be-4985-8f02-1c714ea57822 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:52.376532 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-7ce19578-e5be-4985-8f02-1c714ea57822 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] [instance: ffe67fde-94fd-494e-a62f-cf488fdec9ae] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:52.384510 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7ce19578-e5be-4985-8f02-1c714ea57822 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:52.384752 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7ce19578-e5be-4985-8f02-1c714ea57822 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:52.385528 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7ce19578-e5be-4985-8f02-1c714ea57822 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:52.386637 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7ce19578-e5be-4985-8f02-1c714ea57822 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:52.584341 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-7ce19578-e5be-4985-8f02-1c714ea57822 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8636edba3b8a4d8ca7843b7d882300c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd161d2feb00e4986902d6fa841f0ca59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:52.596893 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-7ce19578-e5be-4985-8f02-1c714ea57822 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae" status: 200 len: 1465 microversion: 2.1 time: 0.225908 Aug 02 09:19:52.597484 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 504/983] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:52 2022] GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae => generated 1465 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:52.649000 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-7c142e6d-8fd2-44f7-8bae-02b0d70cd203 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:52.649499 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-7c142e6d-8fd2-44f7-8bae-02b0d70cd203 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] [instance: ffe67fde-94fd-494e-a62f-cf488fdec9ae] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:52.656146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7c142e6d-8fd2-44f7-8bae-02b0d70cd203 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:52.657007 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7c142e6d-8fd2-44f7-8bae-02b0d70cd203 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:52.657812 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7c142e6d-8fd2-44f7-8bae-02b0d70cd203 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:52.658269 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-7c142e6d-8fd2-44f7-8bae-02b0d70cd203 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:52.687493 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-7c142e6d-8fd2-44f7-8bae-02b0d70cd203 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] [instance: ffe67fde-94fd-494e-a62f-cf488fdec9ae] Going to try to terminate instance {{(pid=118526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:19:53.099990 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-7c142e6d-8fd2-44f7-8bae-02b0d70cd203 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae" status: 204 len: 0 microversion: 2.1 time: 0.454883 Aug 02 09:19:53.100699 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 480/984] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:19:52 2022] DELETE /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae => generated 0 bytes in 457 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:19:53.117894 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-a26475af-a81b-4404-8a22-018c81ea247b tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:53.118532 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-a26475af-a81b-4404-8a22-018c81ea247b tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] [instance: ffe67fde-94fd-494e-a62f-cf488fdec9ae] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:53.131856 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a26475af-a81b-4404-8a22-018c81ea247b tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:53.132334 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a26475af-a81b-4404-8a22-018c81ea247b tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:53.133122 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a26475af-a81b-4404-8a22-018c81ea247b tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:53.133555 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-a26475af-a81b-4404-8a22-018c81ea247b tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:53.323698 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-a26475af-a81b-4404-8a22-018c81ea247b tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8636edba3b8a4d8ca7843b7d882300c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd161d2feb00e4986902d6fa841f0ca59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:53.328685 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-bbcd2e05-19cf-482f-b152-d9fb41aebe61 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:53.329537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-bbcd2e05-19cf-482f-b152-d9fb41aebe61 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:53.331854 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-a26475af-a81b-4404-8a22-018c81ea247b tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae" status: 200 len: 1471 microversion: 2.1 time: 0.225557 Aug 02 09:19:53.333362 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 505/985] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:53 2022] GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae => generated 1471 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:53.337785 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bbcd2e05-19cf-482f-b152-d9fb41aebe61 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:53.338411 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bbcd2e05-19cf-482f-b152-d9fb41aebe61 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:53.339227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bbcd2e05-19cf-482f-b152-d9fb41aebe61 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:53.339757 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bbcd2e05-19cf-482f-b152-d9fb41aebe61 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:53.406864 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-bbcd2e05-19cf-482f-b152-d9fb41aebe61 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:53.416341 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-bbcd2e05-19cf-482f-b152-d9fb41aebe61 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815" status: 200 len: 1276 microversion: 2.1 time: 0.091670 Aug 02 09:19:53.416341 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 481/986] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:53 2022] GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815 => generated 1276 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:54.356857 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-98a18ef8-0faf-48df-81a2-cad9c2b1cf40 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:54.358237 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-98a18ef8-0faf-48df-81a2-cad9c2b1cf40 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] [instance: ffe67fde-94fd-494e-a62f-cf488fdec9ae] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:54.365762 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-98a18ef8-0faf-48df-81a2-cad9c2b1cf40 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:54.366233 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-98a18ef8-0faf-48df-81a2-cad9c2b1cf40 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:54.367010 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-98a18ef8-0faf-48df-81a2-cad9c2b1cf40 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:54.367533 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-98a18ef8-0faf-48df-81a2-cad9c2b1cf40 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:54.438800 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-0b442f61-884c-46b7-a4f7-fb7d73cf200a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:54.439492 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-0b442f61-884c-46b7-a4f7-fb7d73cf200a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:54.446121 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0b442f61-884c-46b7-a4f7-fb7d73cf200a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:54.446871 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0b442f61-884c-46b7-a4f7-fb7d73cf200a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:54.447470 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0b442f61-884c-46b7-a4f7-fb7d73cf200a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:54.447914 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-0b442f61-884c-46b7-a4f7-fb7d73cf200a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:54.715514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-98a18ef8-0faf-48df-81a2-cad9c2b1cf40 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8636edba3b8a4d8ca7843b7d882300c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd161d2feb00e4986902d6fa841f0ca59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:54.715514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-98a18ef8-0faf-48df-81a2-cad9c2b1cf40 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae" status: 200 len: 1471 microversion: 2.1 time: 0.362546 Aug 02 09:19:54.715514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 506/987] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:54 2022] GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae => generated 1471 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:54.798108 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-0b442f61-884c-46b7-a4f7-fb7d73cf200a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:54.806146 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-0b442f61-884c-46b7-a4f7-fb7d73cf200a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815" status: 200 len: 1318 microversion: 2.1 time: 0.371274 Aug 02 09:19:54.807770 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 482/988] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:54 2022] GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815 => generated 1318 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:55.429665 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-6ff672d0-346d-40eb-89f3-0a6e0f66d161 req-0b22718b-ddd0-4a3c-a32b-0a6258eb1016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffe67fde-94fd-494e-a62f-cf488fdec9ae", "name": "network-vif-deleted", "tag": "03d0ebe1-0402-4802-a135-a5c51cb1b553"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:19:55.445767 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-6ff672d0-346d-40eb-89f3-0a6e0f66d161 req-0b22718b-ddd0-4a3c-a32b-0a6258eb1016 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:55.447306 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-6ff672d0-346d-40eb-89f3-0a6e0f66d161 req-0b22718b-ddd0-4a3c-a32b-0a6258eb1016 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:55.463179 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-6ff672d0-346d-40eb-89f3-0a6e0f66d161 req-0b22718b-ddd0-4a3c-a32b-0a6258eb1016 service nova] Creating event network-vif-deleted:03d0ebe1-0402-4802-a135-a5c51cb1b553 for instance ffe67fde-94fd-494e-a62f-cf488fdec9ae on hv-cinder-84599 Aug 02 09:19:55.470083 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-6ff672d0-346d-40eb-89f3-0a6e0f66d161 req-0b22718b-ddd0-4a3c-a32b-0a6258eb1016 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048517 Aug 02 09:19:55.471070 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 507/989] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:55.736768 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-04640936-bdb5-47cb-935f-6e15c48552bc tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:55.737383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-04640936-bdb5-47cb-935f-6e15c48552bc tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] [instance: ffe67fde-94fd-494e-a62f-cf488fdec9ae] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:55.745098 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-04640936-bdb5-47cb-935f-6e15c48552bc tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:55.745547 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-04640936-bdb5-47cb-935f-6e15c48552bc tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:55.746326 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-04640936-bdb5-47cb-935f-6e15c48552bc tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:55.746948 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-04640936-bdb5-47cb-935f-6e15c48552bc tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:55.783403 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-04640936-bdb5-47cb-935f-6e15c48552bc tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:55.783859 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-04640936-bdb5-47cb-935f-6e15c48552bc tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:55.784333 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.objects.instance [None req-04640936-bdb5-47cb-935f-6e15c48552bc tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lazy-loading 'fault' on Instance uuid ffe67fde-94fd-494e-a62f-cf488fdec9ae {{(pid=118526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:19:55.834595 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-2de359c6-a510-454e-96db-acf2be3b6452 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:55.835393 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-2de359c6-a510-454e-96db-acf2be3b6452 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:55.842109 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2de359c6-a510-454e-96db-acf2be3b6452 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:55.842651 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2de359c6-a510-454e-96db-acf2be3b6452 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:55.843500 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2de359c6-a510-454e-96db-acf2be3b6452 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:55.844033 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2de359c6-a510-454e-96db-acf2be3b6452 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:55.863628 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-04640936-bdb5-47cb-935f-6e15c48552bc tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8636edba3b8a4d8ca7843b7d882300c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd161d2feb00e4986902d6fa841f0ca59', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:55.873286 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-04640936-bdb5-47cb-935f-6e15c48552bc tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae" status: 200 len: 1305 microversion: 2.1 time: 0.140787 Aug 02 09:19:55.874092 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 483/990] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:55 2022] GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae => generated 1305 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:56.005250 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-2de359c6-a510-454e-96db-acf2be3b6452 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:56.013258 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-2de359c6-a510-454e-96db-acf2be3b6452 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815" status: 200 len: 1318 microversion: 2.1 time: 0.183766 Aug 02 09:19:56.013822 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 508/991] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:55 2022] GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:19:56.901352 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-66a78be8-abb7-4971-bde6-b355302b6a38 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:56.902081 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-66a78be8-abb7-4971-bde6-b355302b6a38 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] [instance: ffe67fde-94fd-494e-a62f-cf488fdec9ae] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:56.909225 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-66a78be8-abb7-4971-bde6-b355302b6a38 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:56.909673 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-66a78be8-abb7-4971-bde6-b355302b6a38 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:56.911226 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-66a78be8-abb7-4971-bde6-b355302b6a38 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:56.911756 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-66a78be8-abb7-4971-bde6-b355302b6a38 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:56.926820 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-66a78be8-abb7-4971-bde6-b355302b6a38 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] HTTP exception thrown: Instance ffe67fde-94fd-494e-a62f-cf488fdec9ae could not be found. Aug 02 09:19:56.928945 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-66a78be8-abb7-4971-bde6-b355302b6a38 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Request method failure captured: Aug 02 09:19:56.928945 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae HTTP/1.1 Aug 02 09:19:56.928945 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:19:56.928945 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:19:56.928945 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:19:56.928945 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:19:56.928945 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:19:56.928945 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:19:56.928945 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:19:56.928945 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:19:56.928945 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6Owgi44h1CoVQGypzEe6JeLE1GE9TZB2DJvNRrL18NyR9DHpcd_IV92oa1JISA6R8nyTWcd-4H6tigVcrdIyzLCoL0n6co14r2vtnPEunOaaI0sf-ESQb05Bhj-T-z-cfuEtAMnSRBrL-jbahpRuWEozmhKPZ23W4_HL_AGvU0mo2-I Aug 02 09:19:56.928945 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:19:56.928945 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:19:56.928945 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:19:56.928945 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:19:56.928945 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:19:56.928945 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:19:56.928945 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: d161d2feb00e4986902d6fa841f0ca59 Aug 02 09:19:56.928945 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-VolumesNegativeTest-652143418 Aug 02 09:19:56.928945 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:19:56.928945 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:19:56.935861 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d161d2feb00e4986902d6fa841f0ca59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/d161d2feb00e4986902d6fa841f0ca59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/d161d2feb00e4986902d6fa841f0ca59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_d161d2feb00e4986902d6fa841f0ca59"}]}] Aug 02 09:19:56.935861 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-VolumesNegativeTest-652143418 Aug 02 09:19:56.935861 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: d161d2feb00e4986902d6fa841f0ca59 Aug 02 09:19:56.935861 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-VolumesNegativeTest-652143418 Aug 02 09:19:56.935861 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-VolumesNegativeTest-652143418-project Aug 02 09:19:56.935861 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:19:56.935861 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:19:56.935861 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: 8636edba3b8a4d8ca7843b7d882300c0 Aug 02 09:19:56.935861 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-VolumesNegativeTest-652143418-project Aug 02 09:19:56.935861 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:19:56.935861 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Instance ffe67fde-94fd-494e-a62f-cf488fdec9ae could not be found. Aug 02 09:19:56.935861 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'id': 'ffe67fde-94fd-494e-a62f-cf488fdec9ae'} Aug 02 09:19:56.937300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:19:56.937300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:19:56.937300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:19:56.937300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:19:56.937300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:19:56.937300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:19:56.937300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:19:56.937300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:19:56.937300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:19:56.937300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:19:56.937300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffe67fde-94fd-494e-a62f-cf488fdec9ae could not be found. Aug 02 09:19:56.937300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:19:56.937300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:19:56.937300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:19:56.937300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:19:56.937300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:19:56.937300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:19:56.937300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:19:56.937300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:19:56.937300 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:19:56.939837 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:19:56.939837 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:19:56.939837 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:19:56.939837 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:19:56.939837 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:19:56.939837 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:19:56.939837 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:19:56.939837 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffe67fde-94fd-494e-a62f-cf488fdec9ae could not be found. Aug 02 09:19:56.939837 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:19:56.939837 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:19:56.939837 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:19:56.939837 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:19:56.939837 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:19:56.939837 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:19:56.939837 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:19:56.939837 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:19:56.939837 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffe67fde-94fd-494e-a62f-cf488fdec9ae could not be found. Aug 02 09:19:56.939837 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:19:56.943002 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-66a78be8-abb7-4971-bde6-b355302b6a38 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] Returning 404 to user: Instance ffe67fde-94fd-494e-a62f-cf488fdec9ae could not be found. {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:19:56.943002 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-66a78be8-abb7-4971-bde6-b355302b6a38 tempest-VolumesNegativeTest-652143418 tempest-VolumesNegativeTest-652143418-project] 10.222.0.20 "GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae" status: 404 len: 111 microversion: 2.1 time: 0.033433 Aug 02 09:19:56.943002 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 484/992] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:56 2022] GET /compute/v2.1/servers/ffe67fde-94fd-494e-a62f-cf488fdec9ae => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:19:57.036151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-89c5b297-7132-4fdd-acb4-3fa6bba7e962 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:57.036791 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-89c5b297-7132-4fdd-acb4-3fa6bba7e962 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:57.043674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-89c5b297-7132-4fdd-acb4-3fa6bba7e962 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:57.044113 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-89c5b297-7132-4fdd-acb4-3fa6bba7e962 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:57.044928 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-89c5b297-7132-4fdd-acb4-3fa6bba7e962 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:57.045357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-89c5b297-7132-4fdd-acb4-3fa6bba7e962 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:57.203010 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-89c5b297-7132-4fdd-acb4-3fa6bba7e962 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:57.211247 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-89c5b297-7132-4fdd-acb4-3fa6bba7e962 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815" status: 200 len: 1318 microversion: 2.1 time: 0.179730 Aug 02 09:19:57.211523 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 509/993] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:57 2022] GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:57.486054 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-f59a599d-f641-470e-b0f0-3d34e0bdb3dc req-6731d3e2-b3c7-4073-8b37-447e436f9823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b96e111b-3d46-4822-92c7-4341e512e815", "tag": "a483798e-7e22-40d5-8c81-970319fa3d32"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:19:57.496382 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-f59a599d-f641-470e-b0f0-3d34e0bdb3dc req-6731d3e2-b3c7-4073-8b37-447e436f9823 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:57.496836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-f59a599d-f641-470e-b0f0-3d34e0bdb3dc req-6731d3e2-b3c7-4073-8b37-447e436f9823 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:57.511257 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-f59a599d-f641-470e-b0f0-3d34e0bdb3dc req-6731d3e2-b3c7-4073-8b37-447e436f9823 service nova] Creating event network-changed:a483798e-7e22-40d5-8c81-970319fa3d32 for instance b96e111b-3d46-4822-92c7-4341e512e815 on hv-cinder-84599 Aug 02 09:19:57.516282 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-f59a599d-f641-470e-b0f0-3d34e0bdb3dc req-6731d3e2-b3c7-4073-8b37-447e436f9823 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034071 Aug 02 09:19:57.525952 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 485/994] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:19:58.232612 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-53a81867-a859-40c4-b774-c047e8ee6f04 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:58.233379 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-53a81867-a859-40c4-b774-c047e8ee6f04 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:58.235440 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=2 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:58.236197 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=6 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:58.242432 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-53a81867-a859-40c4-b774-c047e8ee6f04 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:58.242869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-53a81867-a859-40c4-b774-c047e8ee6f04 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:58.244005 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-53a81867-a859-40c4-b774-c047e8ee6f04 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:58.244476 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-53a81867-a859-40c4-b774-c047e8ee6f04 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:58.393861 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-53a81867-a859-40c4-b774-c047e8ee6f04 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:58.404775 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-53a81867-a859-40c4-b774-c047e8ee6f04 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815" status: 200 len: 1318 microversion: 2.1 time: 0.176291 Aug 02 09:19:58.405357 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 510/995] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:58 2022] GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:19:59.422899 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=4 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:59.427473 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-3f6d6bec-357a-4c11-a2c3-6ca018256c1a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:19:59.428121 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-3f6d6bec-357a-4c11-a2c3-6ca018256c1a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:19:59.435137 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3f6d6bec-357a-4c11-a2c3-6ca018256c1a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:59.435596 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3f6d6bec-357a-4c11-a2c3-6ca018256c1a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:59.436409 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3f6d6bec-357a-4c11-a2c3-6ca018256c1a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:19:59.436896 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3f6d6bec-357a-4c11-a2c3-6ca018256c1a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:19:59.441195 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:19:59.591597 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-3f6d6bec-357a-4c11-a2c3-6ca018256c1a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:19:59.602184 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-3f6d6bec-357a-4c11-a2c3-6ca018256c1a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815" status: 200 len: 1318 microversion: 2.1 time: 0.180759 Aug 02 09:19:59.602904 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 486/996] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:19:59 2022] GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:00.624153 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d848d74a-5626-4d48-812b-237f77ba4cab tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:00.624843 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-d848d74a-5626-4d48-812b-237f77ba4cab tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:00.632280 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d848d74a-5626-4d48-812b-237f77ba4cab tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:00.632742 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d848d74a-5626-4d48-812b-237f77ba4cab tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:00.633554 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d848d74a-5626-4d48-812b-237f77ba4cab tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:00.633990 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d848d74a-5626-4d48-812b-237f77ba4cab tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:00.773578 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d848d74a-5626-4d48-812b-237f77ba4cab tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:00.781869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-d848d74a-5626-4d48-812b-237f77ba4cab tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815" status: 200 len: 1318 microversion: 2.1 time: 0.161439 Aug 02 09:20:00.782416 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 511/997] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:00 2022] GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:01.805197 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-84804fdd-36c4-4d4a-8fac-1931d8607df7 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:01.805779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-84804fdd-36c4-4d4a-8fac-1931d8607df7 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:01.813945 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-84804fdd-36c4-4d4a-8fac-1931d8607df7 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:01.827035 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-84804fdd-36c4-4d4a-8fac-1931d8607df7 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:01.827035 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-84804fdd-36c4-4d4a-8fac-1931d8607df7 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:01.827035 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-84804fdd-36c4-4d4a-8fac-1931d8607df7 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:01.973001 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-84804fdd-36c4-4d4a-8fac-1931d8607df7 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:01.982032 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-84804fdd-36c4-4d4a-8fac-1931d8607df7 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815" status: 200 len: 1318 microversion: 2.1 time: 0.181484 Aug 02 09:20:01.982708 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 487/998] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:01 2022] GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815 => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:03.003806 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-21bbd253-d618-4a6f-ad97-0523919f860a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:03.004608 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-21bbd253-d618-4a6f-ad97-0523919f860a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:03.012476 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-21bbd253-d618-4a6f-ad97-0523919f860a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:03.012948 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-21bbd253-d618-4a6f-ad97-0523919f860a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:03.013836 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-21bbd253-d618-4a6f-ad97-0523919f860a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:03.014353 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-21bbd253-d618-4a6f-ad97-0523919f860a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:03.154234 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-21bbd253-d618-4a6f-ad97-0523919f860a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:03.161890 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-21bbd253-d618-4a6f-ad97-0523919f860a tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815" status: 200 len: 1318 microversion: 2.1 time: 0.162658 Aug 02 09:20:03.162453 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 512/999] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:02 2022] GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:04.184624 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-1e58a017-a957-4060-b34d-8e02865c92f0 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:04.184624 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-1e58a017-a957-4060-b34d-8e02865c92f0 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:04.186736 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:04.191837 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1e58a017-a957-4060-b34d-8e02865c92f0 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:04.192421 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1e58a017-a957-4060-b34d-8e02865c92f0 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:04.193474 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1e58a017-a957-4060-b34d-8e02865c92f0 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:04.193965 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1e58a017-a957-4060-b34d-8e02865c92f0 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:04.407636 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-1e58a017-a957-4060-b34d-8e02865c92f0 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:04.427539 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-1e58a017-a957-4060-b34d-8e02865c92f0 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815" status: 200 len: 1318 microversion: 2.1 time: 0.239870 Aug 02 09:20:04.427539 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 488/1000] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:04 2022] GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:04.773526 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-2af36596-64f0-406f-a1f1-6f6036e9f814 req-4fca2e9f-062f-4884-a879-37add04c3c1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96e111b-3d46-4822-92c7-4341e512e815", "name": "network-vif-plugged", "status": "completed", "tag": "a483798e-7e22-40d5-8c81-970319fa3d32"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:20:04.782518 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:04.788559 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-2af36596-64f0-406f-a1f1-6f6036e9f814 req-4fca2e9f-062f-4884-a879-37add04c3c1b service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:04.789005 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-2af36596-64f0-406f-a1f1-6f6036e9f814 req-4fca2e9f-062f-4884-a879-37add04c3c1b service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:04.792446 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=97 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:04.802483 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-2af36596-64f0-406f-a1f1-6f6036e9f814 req-4fca2e9f-062f-4884-a879-37add04c3c1b service nova] Creating event network-vif-plugged:a483798e-7e22-40d5-8c81-970319fa3d32 for instance b96e111b-3d46-4822-92c7-4341e512e815 on hv-cinder-84599 Aug 02 09:20:04.807920 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-2af36596-64f0-406f-a1f1-6f6036e9f814 req-4fca2e9f-062f-4884-a879-37add04c3c1b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040062 Aug 02 09:20:04.808564 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 513/1001] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:05.441790 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-3f4ae7b9-43d1-4390-a1bc-ce288dbafb8f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:05.442700 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-3f4ae7b9-43d1-4390-a1bc-ce288dbafb8f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:05.450390 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3f4ae7b9-43d1-4390-a1bc-ce288dbafb8f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:05.450856 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3f4ae7b9-43d1-4390-a1bc-ce288dbafb8f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:05.451622 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3f4ae7b9-43d1-4390-a1bc-ce288dbafb8f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:05.452053 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3f4ae7b9-43d1-4390-a1bc-ce288dbafb8f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:05.612848 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-3f4ae7b9-43d1-4390-a1bc-ce288dbafb8f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:05.621659 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-3f4ae7b9-43d1-4390-a1bc-ce288dbafb8f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815" status: 200 len: 1318 microversion: 2.1 time: 0.183682 Aug 02 09:20:05.622313 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 489/1002] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:05 2022] GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815 => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:06.644853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-5a459403-65bc-4edc-9c45-2caec407645b tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:06.645477 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-5a459403-65bc-4edc-9c45-2caec407645b tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:06.653182 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5a459403-65bc-4edc-9c45-2caec407645b tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:06.653650 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5a459403-65bc-4edc-9c45-2caec407645b tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:06.654410 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5a459403-65bc-4edc-9c45-2caec407645b tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:06.654841 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5a459403-65bc-4edc-9c45-2caec407645b tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:06.798004 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-5a459403-65bc-4edc-9c45-2caec407645b tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:06.807295 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-5a459403-65bc-4edc-9c45-2caec407645b tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815" status: 200 len: 1318 microversion: 2.1 time: 0.167290 Aug 02 09:20:06.807855 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 514/1003] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:06 2022] GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:07.830071 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c2fbd02a-b6a3-4821-9349-757a623d4bbd tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:07.830717 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-c2fbd02a-b6a3-4821-9349-757a623d4bbd tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:07.838627 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c2fbd02a-b6a3-4821-9349-757a623d4bbd tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:07.839081 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c2fbd02a-b6a3-4821-9349-757a623d4bbd tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:07.839951 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c2fbd02a-b6a3-4821-9349-757a623d4bbd tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:07.840415 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c2fbd02a-b6a3-4821-9349-757a623d4bbd tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:07.978815 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-c2fbd02a-b6a3-4821-9349-757a623d4bbd tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:07.986985 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-c2fbd02a-b6a3-4821-9349-757a623d4bbd tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815" status: 200 len: 1507 microversion: 2.1 time: 0.160742 Aug 02 09:20:07.990222 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 490/1004] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:07 2022] GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:08.715391 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-c97fbaed-aa39-48b7-b284-c252d399770b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1261643090", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1068068850", "security_groups": [{"name": "tempest-secgroup-smoke-1032874180"}], "block_device_mapping_v2": [{"uuid": "dbb602ae-9887-4ea5-b886-e2ff87f23e0f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "591148ac-b480-44cf-8cb3-9d42c0440114"}]}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:20:08.866902 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.network.neutron [None req-c97fbaed-aa39-48b7-b284-c252d399770b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] validate_networks() for [('591148ac-b480-44cf-8cb3-9d42c0440114', None, None, None, None, None)] {{(pid=118525) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:20:09.287987 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-c97fbaed-aa39-48b7-b284-c252d399770b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Flavor limits 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:20:09.291378 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-c97fbaed-aa39-48b7-b284-c252d399770b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Image limits 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:20:09.293148 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-c97fbaed-aa39-48b7-b284-c252d399770b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Flavor pref 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:20:09.293576 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-c97fbaed-aa39-48b7-b284-c252d399770b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Image pref 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:20:09.293997 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-c97fbaed-aa39-48b7-b284-c252d399770b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:20:09.308010 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c97fbaed-aa39-48b7-b284-c252d399770b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:09.308766 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c97fbaed-aa39-48b7-b284-c252d399770b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:09.309811 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c97fbaed-aa39-48b7-b284-c252d399770b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:09.310199 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c97fbaed-aa39-48b7-b284-c252d399770b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:09.330986 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-c97fbaed-aa39-48b7-b284-c252d399770b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Getting quotas for project 8e8d4b340fc54e639758d911a5ab16a7. Resources: {'cores', 'ram', 'instances'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:20:09.336127 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-c97fbaed-aa39-48b7-b284-c252d399770b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Getting quotas for user c0a2b49114e0458f9625de698cc89861 and project 8e8d4b340fc54e639758d911a5ab16a7. Resources: {'cores', 'ram', 'instances'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:20:09.402685 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-c97fbaed-aa39-48b7-b284-c252d399770b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Going to run 1 instances... {{(pid=118525) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:20:09.404929 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-c97fbaed-aa39-48b7-b284-c252d399770b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dbb602ae-9887-4ea5-b886-e2ff87f23e0f',volume_size=None,volume_type=None)] {{(pid=118525) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:20:09.973847 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-c97fbaed-aa39-48b7-b284-c252d399770b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.262985 Aug 02 09:20:09.976299 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 515/1005] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 2 09:20:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 1267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:20:09.986827 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-3f026617-cc28-4001-9c8d-b25b2f2db821 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:09.987458 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-3f026617-cc28-4001-9c8d-b25b2f2db821 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:10.045786 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-3f026617-cc28-4001-9c8d-b25b2f2db821 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:10.052448 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-3f026617-cc28-4001-9c8d-b25b2f2db821 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20" status: 200 len: 1095 microversion: 2.1 time: 0.069457 Aug 02 09:20:10.053176 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 491/1006] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:09 2022] GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:11.074831 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4c82f1d6-1569-4fff-8983-5357782cedda tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:11.075433 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-4c82f1d6-1569-4fff-8983-5357782cedda tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:11.081869 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4c82f1d6-1569-4fff-8983-5357782cedda tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:11.082307 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4c82f1d6-1569-4fff-8983-5357782cedda tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:11.083082 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4c82f1d6-1569-4fff-8983-5357782cedda tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:11.083511 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4c82f1d6-1569-4fff-8983-5357782cedda tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:11.158824 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-4c82f1d6-1569-4fff-8983-5357782cedda tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:11.171130 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-4c82f1d6-1569-4fff-8983-5357782cedda tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20" status: 200 len: 1145 microversion: 2.1 time: 0.101059 Aug 02 09:20:11.171722 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 516/1007] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:11 2022] GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 => generated 1145 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:12.198006 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-cc27845e-b0c1-452d-8d85-8c57eab2e871 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:12.199579 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-cc27845e-b0c1-452d-8d85-8c57eab2e871 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:12.213286 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cc27845e-b0c1-452d-8d85-8c57eab2e871 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:12.214840 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cc27845e-b0c1-452d-8d85-8c57eab2e871 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:12.214840 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cc27845e-b0c1-452d-8d85-8c57eab2e871 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:12.215111 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cc27845e-b0c1-452d-8d85-8c57eab2e871 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:12.297392 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-cc27845e-b0c1-452d-8d85-8c57eab2e871 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:12.306792 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-cc27845e-b0c1-452d-8d85-8c57eab2e871 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20" status: 200 len: 1193 microversion: 2.1 time: 0.116440 Aug 02 09:20:12.307545 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 492/1008] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:12 2022] GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 => generated 1193 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:13.331325 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-9c1fded5-afa1-4896-ad3e-010fc2705888 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:13.332364 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-9c1fded5-afa1-4896-ad3e-010fc2705888 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:13.341056 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9c1fded5-afa1-4896-ad3e-010fc2705888 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:13.341650 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9c1fded5-afa1-4896-ad3e-010fc2705888 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:13.342879 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9c1fded5-afa1-4896-ad3e-010fc2705888 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:13.343389 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-9c1fded5-afa1-4896-ad3e-010fc2705888 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:13.717844 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-9c1fded5-afa1-4896-ad3e-010fc2705888 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:13.726923 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-9c1fded5-afa1-4896-ad3e-010fc2705888 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20" status: 200 len: 1211 microversion: 2.1 time: 0.399426 Aug 02 09:20:13.727731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 517/1009] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:13 2022] GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 => generated 1211 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:14.756824 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-974dcf13-33c7-4ba8-b836-f255c8d15d6a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:14.757706 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-974dcf13-33c7-4ba8-b836-f255c8d15d6a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:14.770842 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-974dcf13-33c7-4ba8-b836-f255c8d15d6a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:14.772327 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-974dcf13-33c7-4ba8-b836-f255c8d15d6a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:14.774385 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-974dcf13-33c7-4ba8-b836-f255c8d15d6a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:14.774859 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-974dcf13-33c7-4ba8-b836-f255c8d15d6a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:15.008947 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-974dcf13-33c7-4ba8-b836-f255c8d15d6a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:15.018340 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-974dcf13-33c7-4ba8-b836-f255c8d15d6a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20" status: 200 len: 1267 microversion: 2.1 time: 0.271557 Aug 02 09:20:15.018924 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 493/1010] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:14 2022] GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 => generated 1267 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:15.160703 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-65a28e8e-4445-4209-9aa1-2b47ac4919fb req-2668e905-fd69-4027-b9b4-aefbaaaef839 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdfb67c8-1525-4398-adf6-120021432e20", "tag": "ab7cd2d2-0701-413b-b313-69afdf155eac"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:20:15.172023 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-65a28e8e-4445-4209-9aa1-2b47ac4919fb req-2668e905-fd69-4027-b9b4-aefbaaaef839 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:15.172637 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-65a28e8e-4445-4209-9aa1-2b47ac4919fb req-2668e905-fd69-4027-b9b4-aefbaaaef839 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:15.186006 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-65a28e8e-4445-4209-9aa1-2b47ac4919fb req-2668e905-fd69-4027-b9b4-aefbaaaef839 service nova] Creating event network-changed:ab7cd2d2-0701-413b-b313-69afdf155eac for instance cdfb67c8-1525-4398-adf6-120021432e20 on hv-cinder-84599 Aug 02 09:20:15.191861 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-65a28e8e-4445-4209-9aa1-2b47ac4919fb req-2668e905-fd69-4027-b9b4-aefbaaaef839 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034801 Aug 02 09:20:15.192514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 518/1011] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:16.043151 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-d47d58d5-d34b-433c-9a85-8116a7ad6ac5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:16.044335 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-d47d58d5-d34b-433c-9a85-8116a7ad6ac5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:16.052066 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d47d58d5-d34b-433c-9a85-8116a7ad6ac5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:16.052556 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d47d58d5-d34b-433c-9a85-8116a7ad6ac5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:16.053767 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d47d58d5-d34b-433c-9a85-8116a7ad6ac5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:16.054211 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d47d58d5-d34b-433c-9a85-8116a7ad6ac5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:16.218427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-d47d58d5-d34b-433c-9a85-8116a7ad6ac5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:16.232355 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-d47d58d5-d34b-433c-9a85-8116a7ad6ac5 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20" status: 200 len: 1267 microversion: 2.1 time: 0.189433 Aug 02 09:20:16.232355 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 494/1012] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:16 2022] GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 => generated 1267 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:17.254116 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-be8c2f45-5f50-4fe1-95c9-8de80a0eed46 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:17.254708 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-be8c2f45-5f50-4fe1-95c9-8de80a0eed46 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:17.261761 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-be8c2f45-5f50-4fe1-95c9-8de80a0eed46 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:17.262198 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-be8c2f45-5f50-4fe1-95c9-8de80a0eed46 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:17.263002 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-be8c2f45-5f50-4fe1-95c9-8de80a0eed46 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:17.263400 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-be8c2f45-5f50-4fe1-95c9-8de80a0eed46 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:17.431629 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-be8c2f45-5f50-4fe1-95c9-8de80a0eed46 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:17.439443 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-be8c2f45-5f50-4fe1-95c9-8de80a0eed46 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20" status: 200 len: 1267 microversion: 2.1 time: 0.190050 Aug 02 09:20:17.440022 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 519/1013] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:17 2022] GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:18.462658 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c5f47bc6-1452-47d5-aedf-d3d002f05e07 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:18.463237 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-c5f47bc6-1452-47d5-aedf-d3d002f05e07 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:18.469892 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c5f47bc6-1452-47d5-aedf-d3d002f05e07 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:18.470341 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c5f47bc6-1452-47d5-aedf-d3d002f05e07 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:18.471106 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c5f47bc6-1452-47d5-aedf-d3d002f05e07 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:18.471535 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c5f47bc6-1452-47d5-aedf-d3d002f05e07 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:18.618536 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-c5f47bc6-1452-47d5-aedf-d3d002f05e07 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:18.626412 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-c5f47bc6-1452-47d5-aedf-d3d002f05e07 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20" status: 200 len: 1267 microversion: 2.1 time: 0.168032 Aug 02 09:20:18.626991 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 495/1014] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:18 2022] GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:19.647903 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-3872578d-8e1f-41f9-8bd4-af5fda8b8f4b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:19.648539 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-3872578d-8e1f-41f9-8bd4-af5fda8b8f4b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:19.650982 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=2 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:19.651727 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=6 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:19.657147 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3872578d-8e1f-41f9-8bd4-af5fda8b8f4b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:19.657592 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3872578d-8e1f-41f9-8bd4-af5fda8b8f4b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:19.658439 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3872578d-8e1f-41f9-8bd4-af5fda8b8f4b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:19.658874 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3872578d-8e1f-41f9-8bd4-af5fda8b8f4b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:19.986094 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-3872578d-8e1f-41f9-8bd4-af5fda8b8f4b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:19.994350 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-3872578d-8e1f-41f9-8bd4-af5fda8b8f4b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20" status: 200 len: 1267 microversion: 2.1 time: 0.351110 Aug 02 09:20:19.994994 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 520/1015] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:19 2022] GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 => generated 1267 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:21.015328 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-d0447855-6edc-47ca-9ab8-f20ed5d26ffb tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:21.016025 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-d0447855-6edc-47ca-9ab8-f20ed5d26ffb tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:21.018772 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=2 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:21.024506 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d0447855-6edc-47ca-9ab8-f20ed5d26ffb tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:21.030989 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d0447855-6edc-47ca-9ab8-f20ed5d26ffb tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:21.030989 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d0447855-6edc-47ca-9ab8-f20ed5d26ffb tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:21.030989 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d0447855-6edc-47ca-9ab8-f20ed5d26ffb tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:21.173159 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-d0447855-6edc-47ca-9ab8-f20ed5d26ffb tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:21.181625 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-d0447855-6edc-47ca-9ab8-f20ed5d26ffb tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20" status: 200 len: 1267 microversion: 2.1 time: 0.170429 Aug 02 09:20:21.182193 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 496/1016] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:21 2022] GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:22.202603 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-17de9d03-3290-48ba-ab37-feccdc2eb7a4 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:22.203285 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-17de9d03-3290-48ba-ab37-feccdc2eb7a4 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:22.210552 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-17de9d03-3290-48ba-ab37-feccdc2eb7a4 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:22.211001 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-17de9d03-3290-48ba-ab37-feccdc2eb7a4 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:22.211912 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-17de9d03-3290-48ba-ab37-feccdc2eb7a4 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:22.212242 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-17de9d03-3290-48ba-ab37-feccdc2eb7a4 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:22.351748 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-17de9d03-3290-48ba-ab37-feccdc2eb7a4 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:22.359317 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-17de9d03-3290-48ba-ab37-feccdc2eb7a4 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20" status: 200 len: 1267 microversion: 2.1 time: 0.160662 Aug 02 09:20:22.359892 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 521/1017] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:22 2022] GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:23.380828 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a4fe8914-98fd-40d1-947c-a24c3a381ca7 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:23.381706 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-a4fe8914-98fd-40d1-947c-a24c3a381ca7 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:23.391791 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a4fe8914-98fd-40d1-947c-a24c3a381ca7 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:23.392631 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a4fe8914-98fd-40d1-947c-a24c3a381ca7 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:23.393777 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a4fe8914-98fd-40d1-947c-a24c3a381ca7 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:23.394348 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a4fe8914-98fd-40d1-947c-a24c3a381ca7 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:23.634013 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-a4fe8914-98fd-40d1-947c-a24c3a381ca7 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:23.641927 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-a4fe8914-98fd-40d1-947c-a24c3a381ca7 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20" status: 200 len: 1267 microversion: 2.1 time: 0.265369 Aug 02 09:20:23.652413 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 497/1018] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:23 2022] GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 => generated 1267 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:24.664775 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-da00a83e-fe2f-447c-a150-e50e2ceb45b0 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:24.665678 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-da00a83e-fe2f-447c-a150-e50e2ceb45b0 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:24.672731 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-da00a83e-fe2f-447c-a150-e50e2ceb45b0 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:24.673270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-da00a83e-fe2f-447c-a150-e50e2ceb45b0 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:24.674381 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-da00a83e-fe2f-447c-a150-e50e2ceb45b0 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:24.674676 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-da00a83e-fe2f-447c-a150-e50e2ceb45b0 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:24.743076 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-37c7f76e-04da-4907-bdda-d8e94965062e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35efe2fa-d467-487b-9729-f3f0e99e54e1", "device": "/dev/sdb"}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:20:24.751610 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-37c7f76e-04da-4907-bdda-d8e94965062e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:24.759079 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-37c7f76e-04da-4907-bdda-d8e94965062e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:24.760075 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-37c7f76e-04da-4907-bdda-d8e94965062e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:24.763571 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-37c7f76e-04da-4907-bdda-d8e94965062e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:24.764195 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-37c7f76e-04da-4907-bdda-d8e94965062e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:24.847328 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-da00a83e-fe2f-447c-a150-e50e2ceb45b0 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:24.856477 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-da00a83e-fe2f-447c-a150-e50e2ceb45b0 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20" status: 200 len: 1267 microversion: 2.1 time: 0.196194 Aug 02 09:20:24.856991 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 522/1019] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:24 2022] GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:25.559785 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-37c7f76e-04da-4907-bdda-d8e94965062e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "POST /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.825405 Aug 02 09:20:25.560602 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 498/1020] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 2 09:20:24 2022] POST /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815/os-volume_attachments => generated 194 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:20:25.886850 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-378c1d99-be99-4c7e-8138-b6812f6480d4 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:25.887523 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-378c1d99-be99-4c7e-8138-b6812f6480d4 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:25.894185 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-378c1d99-be99-4c7e-8138-b6812f6480d4 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:25.894650 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-378c1d99-be99-4c7e-8138-b6812f6480d4 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:25.895420 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-378c1d99-be99-4c7e-8138-b6812f6480d4 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:25.895857 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-378c1d99-be99-4c7e-8138-b6812f6480d4 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:26.035526 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-378c1d99-be99-4c7e-8138-b6812f6480d4 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:26.044247 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-378c1d99-be99-4c7e-8138-b6812f6480d4 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20" status: 200 len: 1267 microversion: 2.1 time: 0.161226 Aug 02 09:20:26.044992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 523/1021] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:25 2022] GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:26.999265 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-c542eb06-cfea-4b1a-a298-2bbddd721ea8 req-f86cffd0-750e-4664-a293-30b225148ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdfb67c8-1525-4398-adf6-120021432e20", "name": "network-vif-plugged", "status": "completed", "tag": "ab7cd2d2-0701-413b-b313-69afdf155eac"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:20:27.010069 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-c542eb06-cfea-4b1a-a298-2bbddd721ea8 req-f86cffd0-750e-4664-a293-30b225148ddb service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:27.010512 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-c542eb06-cfea-4b1a-a298-2bbddd721ea8 req-f86cffd0-750e-4664-a293-30b225148ddb service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:27.022459 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-c542eb06-cfea-4b1a-a298-2bbddd721ea8 req-f86cffd0-750e-4664-a293-30b225148ddb service nova] Creating event network-vif-plugged:ab7cd2d2-0701-413b-b313-69afdf155eac for instance cdfb67c8-1525-4398-adf6-120021432e20 on hv-cinder-84599 Aug 02 09:20:27.027328 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-c542eb06-cfea-4b1a-a298-2bbddd721ea8 req-f86cffd0-750e-4664-a293-30b225148ddb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032739 Aug 02 09:20:27.030363 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 499/1022] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:20:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:27.065372 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-28c085e9-7c5d-4533-9f13-9f7917109a43 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:27.065995 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-28c085e9-7c5d-4533-9f13-9f7917109a43 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:27.074238 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-28c085e9-7c5d-4533-9f13-9f7917109a43 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:27.074778 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-28c085e9-7c5d-4533-9f13-9f7917109a43 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:27.075809 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-28c085e9-7c5d-4533-9f13-9f7917109a43 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:27.076284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-28c085e9-7c5d-4533-9f13-9f7917109a43 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:27.238919 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-28c085e9-7c5d-4533-9f13-9f7917109a43 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:27.247490 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-28c085e9-7c5d-4533-9f13-9f7917109a43 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20" status: 200 len: 1267 microversion: 2.1 time: 0.185964 Aug 02 09:20:27.248275 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 524/1023] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:27 2022] GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:28.271694 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-61428c2f-0721-4392-9fc0-10211e776af8 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:28.272649 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-61428c2f-0721-4392-9fc0-10211e776af8 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:28.279397 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-61428c2f-0721-4392-9fc0-10211e776af8 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:28.280204 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-61428c2f-0721-4392-9fc0-10211e776af8 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:28.280645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-61428c2f-0721-4392-9fc0-10211e776af8 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:28.281078 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-61428c2f-0721-4392-9fc0-10211e776af8 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:28.432524 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-61428c2f-0721-4392-9fc0-10211e776af8 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:28.440092 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-61428c2f-0721-4392-9fc0-10211e776af8 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20" status: 200 len: 1267 microversion: 2.1 time: 0.174097 Aug 02 09:20:28.440711 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 500/1024] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:28 2022] GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:29.463336 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-b6a388c6-36d6-4265-83db-d73e8d6a3202 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:29.464206 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-b6a388c6-36d6-4265-83db-d73e8d6a3202 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:29.470212 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b6a388c6-36d6-4265-83db-d73e8d6a3202 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:29.470666 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b6a388c6-36d6-4265-83db-d73e8d6a3202 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:29.471442 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b6a388c6-36d6-4265-83db-d73e8d6a3202 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:29.471872 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b6a388c6-36d6-4265-83db-d73e8d6a3202 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:29.619294 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-b6a388c6-36d6-4265-83db-d73e8d6a3202 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:29.627125 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-b6a388c6-36d6-4265-83db-d73e8d6a3202 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20" status: 200 len: 1455 microversion: 2.1 time: 0.169214 Aug 02 09:20:29.627718 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 525/1025] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:29 2022] GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 => generated 1455 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:29.649044 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-1024a4ab-aef7-4663-a2fe-7ca339b4c05b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:29.649672 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-1024a4ab-aef7-4663-a2fe-7ca339b4c05b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:29.656398 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1024a4ab-aef7-4663-a2fe-7ca339b4c05b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:29.666518 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1024a4ab-aef7-4663-a2fe-7ca339b4c05b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:29.666518 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1024a4ab-aef7-4663-a2fe-7ca339b4c05b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:29.666518 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1024a4ab-aef7-4663-a2fe-7ca339b4c05b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:29.801788 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-1024a4ab-aef7-4663-a2fe-7ca339b4c05b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:29.810608 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-1024a4ab-aef7-4663-a2fe-7ca339b4c05b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20" status: 200 len: 1455 microversion: 2.1 time: 0.165720 Aug 02 09:20:29.811254 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 501/1026] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:29 2022] GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 => generated 1455 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:32.134572 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-c1125766-cc10-436e-b297-eb849c0c8a8d req-53bc0878-f4cf-4f29-85fc-ca7d74c6803f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdfb67c8-1525-4398-adf6-120021432e20", "tag": "ab7cd2d2-0701-413b-b313-69afdf155eac"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:20:32.145146 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-c1125766-cc10-436e-b297-eb849c0c8a8d req-53bc0878-f4cf-4f29-85fc-ca7d74c6803f service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:32.146538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-c1125766-cc10-436e-b297-eb849c0c8a8d req-53bc0878-f4cf-4f29-85fc-ca7d74c6803f service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:32.164014 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-c1125766-cc10-436e-b297-eb849c0c8a8d req-53bc0878-f4cf-4f29-85fc-ca7d74c6803f service nova] Creating event network-changed:ab7cd2d2-0701-413b-b313-69afdf155eac for instance cdfb67c8-1525-4398-adf6-120021432e20 on hv-cinder-84599 Aug 02 09:20:32.172088 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-c1125766-cc10-436e-b297-eb849c0c8a8d req-53bc0878-f4cf-4f29-85fc-ca7d74c6803f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041739 Aug 02 09:20:32.173056 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 526/1027] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:37.003277 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:20:37.004035 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Tue Aug 2 09:20:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:20:43.067344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:20:43.067972 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Tue Aug 2 09:20:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:20:50.661389 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-523d4a87-edfb-4108-aed2-4c5b5fc8d44f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:50.668784 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-523d4a87-edfb-4108-aed2-4c5b5fc8d44f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:50.668784 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=29 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:50.668784 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:50.670828 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-523d4a87-edfb-4108-aed2-4c5b5fc8d44f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:50.671271 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-523d4a87-edfb-4108-aed2-4c5b5fc8d44f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:50.672041 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-523d4a87-edfb-4108-aed2-4c5b5fc8d44f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:50.672499 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-523d4a87-edfb-4108-aed2-4c5b5fc8d44f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:50.758124 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.objects.instance [None req-523d4a87-edfb-4108-aed2-4c5b5fc8d44f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lazy-loading 'services' on Instance uuid b96e111b-3d46-4822-92c7-4341e512e815 {{(pid=118526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:20:50.956943 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-523d4a87-edfb-4108-aed2-4c5b5fc8d44f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815/os-volume_attachments/35efe2fa-d467-487b-9729-f3f0e99e54e1" status: 202 len: 0 microversion: 2.1 time: 0.304249 Aug 02 09:20:50.957506 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 502/1028] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 2 09:20:50 2022] DELETE /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815/os-volume_attachments/35efe2fa-d467-487b-9729-f3f0e99e54e1 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:20:53.158897 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:53.159627 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=67 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:20:53.164653 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-978e0b24-81a2-4c63-b6b8-2570dee3b206 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:53.165304 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-978e0b24-81a2-4c63-b6b8-2570dee3b206 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:53.171642 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-978e0b24-81a2-4c63-b6b8-2570dee3b206 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:53.172095 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-978e0b24-81a2-4c63-b6b8-2570dee3b206 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:53.172908 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-978e0b24-81a2-4c63-b6b8-2570dee3b206 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:53.173347 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-978e0b24-81a2-4c63-b6b8-2570dee3b206 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:53.200432 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-978e0b24-81a2-4c63-b6b8-2570dee3b206 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Going to try to terminate instance {{(pid=118525) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:20:53.683026 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-978e0b24-81a2-4c63-b6b8-2570dee3b206 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815" status: 204 len: 0 microversion: 2.1 time: 0.525748 Aug 02 09:20:53.683677 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 527/1029] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:20:53 2022] DELETE /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:20:53.692780 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a9fb113c-5cef-4476-b138-e374578bdb2f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:53.694227 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-a9fb113c-5cef-4476-b138-e374578bdb2f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:53.701725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a9fb113c-5cef-4476-b138-e374578bdb2f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:53.715484 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a9fb113c-5cef-4476-b138-e374578bdb2f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:53.715484 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a9fb113c-5cef-4476-b138-e374578bdb2f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:53.715484 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a9fb113c-5cef-4476-b138-e374578bdb2f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:53.858708 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-a9fb113c-5cef-4476-b138-e374578bdb2f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:53.868530 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-a9fb113c-5cef-4476-b138-e374578bdb2f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815" status: 200 len: 1513 microversion: 2.1 time: 0.180182 Aug 02 09:20:53.869166 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 503/1030] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:53 2022] GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815 => generated 1513 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:54.891707 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-b8959ac8-0720-44ff-8bd3-571e317cd803 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:54.892568 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-b8959ac8-0720-44ff-8bd3-571e317cd803 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:54.900721 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b8959ac8-0720-44ff-8bd3-571e317cd803 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:54.901166 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b8959ac8-0720-44ff-8bd3-571e317cd803 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:54.901954 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b8959ac8-0720-44ff-8bd3-571e317cd803 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:54.902382 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-b8959ac8-0720-44ff-8bd3-571e317cd803 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:55.044080 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-b8959ac8-0720-44ff-8bd3-571e317cd803 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:55.052837 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-b8959ac8-0720-44ff-8bd3-571e317cd803 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815" status: 200 len: 1513 microversion: 2.1 time: 0.164890 Aug 02 09:20:55.052837 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 528/1031] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:54 2022] GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:20:56.059166 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-a6e49328-182d-4659-b221-758539732e1a req-4d6536eb-1be6-46d3-b930-b103da5c5013 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b96e111b-3d46-4822-92c7-4341e512e815", "name": "network-vif-deleted", "tag": "a483798e-7e22-40d5-8c81-970319fa3d32"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:20:56.074034 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-6ca55dc6-9403-4fd9-a0a4-00ab9271b9b6 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:56.074785 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-6ca55dc6-9403-4fd9-a0a4-00ab9271b9b6 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:56.076020 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-a6e49328-182d-4659-b221-758539732e1a req-4d6536eb-1be6-46d3-b930-b103da5c5013 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:56.076473 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-a6e49328-182d-4659-b221-758539732e1a req-4d6536eb-1be6-46d3-b930-b103da5c5013 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:56.081822 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6ca55dc6-9403-4fd9-a0a4-00ab9271b9b6 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:56.082467 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6ca55dc6-9403-4fd9-a0a4-00ab9271b9b6 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:56.083030 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6ca55dc6-9403-4fd9-a0a4-00ab9271b9b6 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:56.083462 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-6ca55dc6-9403-4fd9-a0a4-00ab9271b9b6 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:56.089070 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-a6e49328-182d-4659-b221-758539732e1a req-4d6536eb-1be6-46d3-b930-b103da5c5013 service nova] Creating event network-vif-deleted:a483798e-7e22-40d5-8c81-970319fa3d32 for instance b96e111b-3d46-4822-92c7-4341e512e815 on hv-cinder-84599 Aug 02 09:20:56.094269 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-a6e49328-182d-4659-b221-758539732e1a req-4d6536eb-1be6-46d3-b930-b103da5c5013 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039315 Aug 02 09:20:56.095059 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 504/1032] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:20:56.150729 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-6ca55dc6-9403-4fd9-a0a4-00ab9271b9b6 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:20:56.158901 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-6ca55dc6-9403-4fd9-a0a4-00ab9271b9b6 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815" status: 200 len: 1471 microversion: 2.1 time: 0.088826 Aug 02 09:20:56.159978 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 529/1033] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:56 2022] GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815 => generated 1471 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:20:57.181732 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-90a10635-f775-44b3-8405-76a7ad8e0cae tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:20:57.182444 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-90a10635-f775-44b3-8405-76a7ad8e0cae tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: b96e111b-3d46-4822-92c7-4341e512e815] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:20:57.192898 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-90a10635-f775-44b3-8405-76a7ad8e0cae tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:57.193769 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-90a10635-f775-44b3-8405-76a7ad8e0cae tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:57.195500 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-90a10635-f775-44b3-8405-76a7ad8e0cae tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:20:57.196753 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-90a10635-f775-44b3-8405-76a7ad8e0cae tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:20:57.225099 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-90a10635-f775-44b3-8405-76a7ad8e0cae tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] HTTP exception thrown: Instance b96e111b-3d46-4822-92c7-4341e512e815 could not be found. Aug 02 09:20:57.228561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-90a10635-f775-44b3-8405-76a7ad8e0cae tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Request method failure captured: Aug 02 09:20:57.228561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815 HTTP/1.1 Aug 02 09:20:57.228561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:20:57.228561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:20:57.228561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:20:57.228561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:20:57.228561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:20:57.228561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:20:57.228561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:20:57.228561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:20:57.228561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6Owv7n2v4-3F9IydLnCuvjyDq18gICWY6PZm8ioQEPCCyOOQd54wbvnVhn683dssfchFAC9B5mbO013f-8f8Au9LPZDqBEus41KfLCD5TJGEANw17cE8QEZBiKkpkassF3-ift4MFuwm53iHRWYHP8a_FumHrYwuPAyLgxIntgEDAXs Aug 02 09:20:57.228561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:20:57.228561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:20:57.228561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:20:57.228561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:20:57.228561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:20:57.228561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:20:57.228561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: 533a6226184d43a5b13c9da2c4a5d971 Aug 02 09:20:57.228561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1139804103 Aug 02 09:20:57.228561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:20:57.228561 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:20:57.235335 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/533a6226184d43a5b13c9da2c4a5d971"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/533a6226184d43a5b13c9da2c4a5d971"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/533a6226184d43a5b13c9da2c4a5d971"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_533a6226184d43a5b13c9da2c4a5d971"}]}] Aug 02 09:20:57.235335 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-VolumesSnapshotTestJSON-1139804103 Aug 02 09:20:57.235335 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: 533a6226184d43a5b13c9da2c4a5d971 Aug 02 09:20:57.235335 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1139804103 Aug 02 09:20:57.235335 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-VolumesSnapshotTestJSON-1139804103-project Aug 02 09:20:57.235335 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:20:57.235335 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:20:57.235335 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: a6a74b4d273744a1bad7637f6c7c6e23 Aug 02 09:20:57.235335 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-VolumesSnapshotTestJSON-1139804103-project Aug 02 09:20:57.235335 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:20:57.235335 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Instance b96e111b-3d46-4822-92c7-4341e512e815 could not be found. Aug 02 09:20:57.235335 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'id': 'b96e111b-3d46-4822-92c7-4341e512e815'} Aug 02 09:20:57.236843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:20:57.236843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:20:57.236843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:20:57.236843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:20:57.236843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:20:57.236843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:20:57.236843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:20:57.236843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:20:57.236843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:20:57.236843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:20:57.236843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b96e111b-3d46-4822-92c7-4341e512e815 could not be found. Aug 02 09:20:57.236843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:20:57.236843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:20:57.236843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:20:57.236843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:20:57.236843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:20:57.236843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:20:57.236843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:20:57.236843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:20:57.236843 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:20:57.238383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:20:57.238383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:20:57.238383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:20:57.238383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:20:57.238383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:20:57.238383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:20:57.238383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:20:57.238383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b96e111b-3d46-4822-92c7-4341e512e815 could not be found. Aug 02 09:20:57.238383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:20:57.238383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:20:57.238383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:20:57.238383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:20:57.238383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:20:57.238383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:20:57.238383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:20:57.238383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:20:57.238383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b96e111b-3d46-4822-92c7-4341e512e815 could not be found. Aug 02 09:20:57.238383 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:20:57.239864 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-90a10635-f775-44b3-8405-76a7ad8e0cae tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Returning 404 to user: Instance b96e111b-3d46-4822-92c7-4341e512e815 could not be found. {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:20:57.239864 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-90a10635-f775-44b3-8405-76a7ad8e0cae tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815" status: 404 len: 111 microversion: 2.1 time: 0.053528 Aug 02 09:20:57.239864 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 505/1034] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:20:57 2022] GET /compute/v2.1/servers/b96e111b-3d46-4822-92c7-4341e512e815 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:21:07.814726 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-1deea61c-dbf2-43f0-b3d0-4be9314c3193 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1668258224", "imageRef": "7a52f4c5-c531-494a-b375-4f6dce3abbc2", "flavorRef": "452", "networks": [{"uuid": "aa294ec1-7c45-49c8-9019-eccbb87d89fd"}]}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:21:07.823978 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:07.824686 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:07.871375 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.network.neutron [None req-1deea61c-dbf2-43f0-b3d0-4be9314c3193 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] validate_networks() for [('aa294ec1-7c45-49c8-9019-eccbb87d89fd', None, None, None, None, None)] {{(pid=118525) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:21:08.238908 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-1deea61c-dbf2-43f0-b3d0-4be9314c3193 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Flavor limits 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:21:08.239362 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-1deea61c-dbf2-43f0-b3d0-4be9314c3193 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Image limits 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:21:08.239836 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-1deea61c-dbf2-43f0-b3d0-4be9314c3193 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Flavor pref 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:21:08.240283 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-1deea61c-dbf2-43f0-b3d0-4be9314c3193 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Image pref 0:0:0 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:21:08.240693 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.virt.hardware [None req-1deea61c-dbf2-43f0-b3d0-4be9314c3193 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118525) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:21:08.250819 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1deea61c-dbf2-43f0-b3d0-4be9314c3193 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:08.251269 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1deea61c-dbf2-43f0-b3d0-4be9314c3193 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:08.252086 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1deea61c-dbf2-43f0-b3d0-4be9314c3193 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:08.252549 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1deea61c-dbf2-43f0-b3d0-4be9314c3193 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:08.269779 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-1deea61c-dbf2-43f0-b3d0-4be9314c3193 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Getting quotas for project 533a6226184d43a5b13c9da2c4a5d971. Resources: {'cores', 'ram', 'instances'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:21:08.273758 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-1deea61c-dbf2-43f0-b3d0-4be9314c3193 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Getting quotas for user a6a74b4d273744a1bad7637f6c7c6e23 and project 533a6226184d43a5b13c9da2c4a5d971. Resources: {'cores', 'ram', 'instances'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:21:08.285461 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-1deea61c-dbf2-43f0-b3d0-4be9314c3193 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Going to run 1 instances... {{(pid=118525) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:21:08.287770 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-1deea61c-dbf2-43f0-b3d0-4be9314c3193 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7a52f4c5-c531-494a-b375-4f6dce3abbc2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118525) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:21:08.430656 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-1deea61c-dbf2-43f0-b3d0-4be9314c3193 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619857 Aug 02 09:21:08.431300 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 530/1035] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 2 09:21:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 02 09:21:08.444906 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c747b69c-2864-41b3-bb05-32fcb24ad127 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:08.445536 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-c747b69c-2864-41b3-bb05-32fcb24ad127 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:08.447638 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=8 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:08.448948 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:08.504368 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-c747b69c-2864-41b3-bb05-32fcb24ad127 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:08.513434 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-c747b69c-2864-41b3-bb05-32fcb24ad127 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd" status: 200 len: 1219 microversion: 2.1 time: 0.073280 Aug 02 09:21:08.523596 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 506/1036] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:08 2022] GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd => generated 1219 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:09.535698 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-15c78c5e-306c-4994-abf4-d65e60f9e726 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:09.536351 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-15c78c5e-306c-4994-abf4-d65e60f9e726 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:09.543609 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-15c78c5e-306c-4994-abf4-d65e60f9e726 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:09.543993 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-15c78c5e-306c-4994-abf4-d65e60f9e726 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:09.544819 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-15c78c5e-306c-4994-abf4-d65e60f9e726 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:09.545273 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-15c78c5e-306c-4994-abf4-d65e60f9e726 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:09.612068 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-15c78c5e-306c-4994-abf4-d65e60f9e726 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:09.619517 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-15c78c5e-306c-4994-abf4-d65e60f9e726 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd" status: 200 len: 1223 microversion: 2.1 time: 0.088600 Aug 02 09:21:09.621713 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 531/1037] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:09 2022] GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:10.642548 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-35d4f5c4-6d63-42d2-a035-0f15fcd6171e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:10.643274 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-35d4f5c4-6d63-42d2-a035-0f15fcd6171e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:10.651366 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-35d4f5c4-6d63-42d2-a035-0f15fcd6171e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:10.651947 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-35d4f5c4-6d63-42d2-a035-0f15fcd6171e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:10.652926 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-35d4f5c4-6d63-42d2-a035-0f15fcd6171e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:10.653257 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-35d4f5c4-6d63-42d2-a035-0f15fcd6171e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:10.723952 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-35d4f5c4-6d63-42d2-a035-0f15fcd6171e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:10.732043 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-35d4f5c4-6d63-42d2-a035-0f15fcd6171e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd" status: 200 len: 1279 microversion: 2.1 time: 0.093466 Aug 02 09:21:10.739620 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 507/1038] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:10 2022] GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd => generated 1279 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:21:11.756314 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ae9e6623-93b9-42bd-89e9-1d4d3a59b7fa tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:11.757229 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ae9e6623-93b9-42bd-89e9-1d4d3a59b7fa tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:11.765112 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ae9e6623-93b9-42bd-89e9-1d4d3a59b7fa tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:11.765570 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ae9e6623-93b9-42bd-89e9-1d4d3a59b7fa tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:11.766360 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ae9e6623-93b9-42bd-89e9-1d4d3a59b7fa tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:11.766798 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ae9e6623-93b9-42bd-89e9-1d4d3a59b7fa tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:11.957983 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ae9e6623-93b9-42bd-89e9-1d4d3a59b7fa tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:11.966445 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ae9e6623-93b9-42bd-89e9-1d4d3a59b7fa tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd" status: 200 len: 1319 microversion: 2.1 time: 0.217124 Aug 02 09:21:11.967012 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 532/1039] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:11 2022] GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:12.373832 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-db8bebb0-c43e-420b-ae26-74ef07e2fe7d req-d450d4e8-4c7d-4f51-92f5-f259e149d764 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01e7bbb0-e9fb-4e13-81ab-5df09c1678cd", "tag": "3212ab15-2ab1-46ed-8128-629127557e7f"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:21:12.378040 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-db8bebb0-c43e-420b-ae26-74ef07e2fe7d req-d450d4e8-4c7d-4f51-92f5-f259e149d764 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:12.378492 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-db8bebb0-c43e-420b-ae26-74ef07e2fe7d req-d450d4e8-4c7d-4f51-92f5-f259e149d764 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:12.390697 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-db8bebb0-c43e-420b-ae26-74ef07e2fe7d req-d450d4e8-4c7d-4f51-92f5-f259e149d764 service nova] Creating event network-changed:3212ab15-2ab1-46ed-8128-629127557e7f for instance 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd on hv-cinder-84599 Aug 02 09:21:12.396122 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-db8bebb0-c43e-420b-ae26-74ef07e2fe7d req-d450d4e8-4c7d-4f51-92f5-f259e149d764 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098650 Aug 02 09:21:12.396836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 508/1040] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:12.987117 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-79a15085-430e-453d-8ed3-050b86011278 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:12.987735 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-79a15085-430e-453d-8ed3-050b86011278 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:12.994646 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-79a15085-430e-453d-8ed3-050b86011278 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:12.995096 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-79a15085-430e-453d-8ed3-050b86011278 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:12.996698 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-79a15085-430e-453d-8ed3-050b86011278 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:12.997251 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-79a15085-430e-453d-8ed3-050b86011278 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:13.172034 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-79a15085-430e-453d-8ed3-050b86011278 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:13.179851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-79a15085-430e-453d-8ed3-050b86011278 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd" status: 200 len: 1319 microversion: 2.1 time: 0.196585 Aug 02 09:21:13.180592 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 533/1041] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:12 2022] GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:14.203657 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c475ef10-1283-49e3-946e-44fb67f20403 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:14.204404 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-c475ef10-1283-49e3-946e-44fb67f20403 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:14.210972 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c475ef10-1283-49e3-946e-44fb67f20403 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:14.211426 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c475ef10-1283-49e3-946e-44fb67f20403 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:14.212239 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c475ef10-1283-49e3-946e-44fb67f20403 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:14.212677 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c475ef10-1283-49e3-946e-44fb67f20403 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:14.350475 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-c475ef10-1283-49e3-946e-44fb67f20403 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:14.358698 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-c475ef10-1283-49e3-946e-44fb67f20403 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd" status: 200 len: 1319 microversion: 2.1 time: 0.160487 Aug 02 09:21:14.365222 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 509/1042] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:14 2022] GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:15.379121 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-cd10cf22-d58c-4ec4-8161-18d8ce3f6b92 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:15.379722 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-cd10cf22-d58c-4ec4-8161-18d8ce3f6b92 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:15.387362 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cd10cf22-d58c-4ec4-8161-18d8ce3f6b92 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:15.387855 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cd10cf22-d58c-4ec4-8161-18d8ce3f6b92 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:15.388681 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cd10cf22-d58c-4ec4-8161-18d8ce3f6b92 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:15.389117 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cd10cf22-d58c-4ec4-8161-18d8ce3f6b92 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:15.535575 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-cd10cf22-d58c-4ec4-8161-18d8ce3f6b92 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:15.543458 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-cd10cf22-d58c-4ec4-8161-18d8ce3f6b92 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd" status: 200 len: 1319 microversion: 2.1 time: 0.168067 Aug 02 09:21:15.544040 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 534/1043] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:15 2022] GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:16.565284 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-325b0b43-e768-46c8-a4e3-00b25186bbad tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:16.566099 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-325b0b43-e768-46c8-a4e3-00b25186bbad tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:16.572866 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-325b0b43-e768-46c8-a4e3-00b25186bbad tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:16.573319 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-325b0b43-e768-46c8-a4e3-00b25186bbad tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:16.574940 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-325b0b43-e768-46c8-a4e3-00b25186bbad tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:16.575379 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-325b0b43-e768-46c8-a4e3-00b25186bbad tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:16.723546 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-325b0b43-e768-46c8-a4e3-00b25186bbad tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:16.731817 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-325b0b43-e768-46c8-a4e3-00b25186bbad tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd" status: 200 len: 1319 microversion: 2.1 time: 0.170580 Aug 02 09:21:16.732419 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 510/1044] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:16 2022] GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:21:17.752984 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-763580a1-7cf0-4352-8d95-b81902fc7516 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:17.753628 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-763580a1-7cf0-4352-8d95-b81902fc7516 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:17.760139 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-763580a1-7cf0-4352-8d95-b81902fc7516 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:17.760626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-763580a1-7cf0-4352-8d95-b81902fc7516 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:17.762055 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-763580a1-7cf0-4352-8d95-b81902fc7516 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:17.762588 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-763580a1-7cf0-4352-8d95-b81902fc7516 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:17.900148 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-763580a1-7cf0-4352-8d95-b81902fc7516 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:17.909300 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-763580a1-7cf0-4352-8d95-b81902fc7516 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd" status: 200 len: 1319 microversion: 2.1 time: 0.160272 Aug 02 09:21:17.909895 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 535/1045] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:17 2022] GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:18.932449 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-9dade705-c355-42fb-ab84-9d7aad1c954b tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:18.933082 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-9dade705-c355-42fb-ab84-9d7aad1c954b tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:18.935566 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=2 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:18.940585 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9dade705-c355-42fb-ab84-9d7aad1c954b tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:18.941292 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9dade705-c355-42fb-ab84-9d7aad1c954b tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:18.942059 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9dade705-c355-42fb-ab84-9d7aad1c954b tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:18.942668 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9dade705-c355-42fb-ab84-9d7aad1c954b tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:19.084935 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-9dade705-c355-42fb-ab84-9d7aad1c954b tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:19.093436 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-9dade705-c355-42fb-ab84-9d7aad1c954b tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd" status: 200 len: 1319 microversion: 2.1 time: 0.164848 Aug 02 09:21:19.096718 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 511/1046] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:18 2022] GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:19.160767 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-1e6a81a2-62da-49ab-9ccc-8d5d80f1ce74 req-7d51059a-9c59-4aac-8d16-351448b3611d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01e7bbb0-e9fb-4e13-81ab-5df09c1678cd", "name": "network-vif-plugged", "status": "completed", "tag": "3212ab15-2ab1-46ed-8128-629127557e7f"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:21:19.165807 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=2 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:19.166402 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=6 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:19.172945 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-1e6a81a2-62da-49ab-9ccc-8d5d80f1ce74 req-7d51059a-9c59-4aac-8d16-351448b3611d service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:19.173394 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-1e6a81a2-62da-49ab-9ccc-8d5d80f1ce74 req-7d51059a-9c59-4aac-8d16-351448b3611d service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:19.186974 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-1e6a81a2-62da-49ab-9ccc-8d5d80f1ce74 req-7d51059a-9c59-4aac-8d16-351448b3611d service nova] Creating event network-vif-plugged:3212ab15-2ab1-46ed-8128-629127557e7f for instance 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd on hv-cinder-84599 Aug 02 09:21:19.192544 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-1e6a81a2-62da-49ab-9ccc-8d5d80f1ce74 req-7d51059a-9c59-4aac-8d16-351448b3611d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035382 Aug 02 09:21:19.193259 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 536/1047] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:20.115551 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-5b9c0771-8aeb-4b30-bdfc-fef473802351 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:20.116093 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-5b9c0771-8aeb-4b30-bdfc-fef473802351 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:20.123545 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5b9c0771-8aeb-4b30-bdfc-fef473802351 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:20.123994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5b9c0771-8aeb-4b30-bdfc-fef473802351 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:20.124797 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5b9c0771-8aeb-4b30-bdfc-fef473802351 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:20.125236 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-5b9c0771-8aeb-4b30-bdfc-fef473802351 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:20.267669 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-5b9c0771-8aeb-4b30-bdfc-fef473802351 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:20.277531 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-5b9c0771-8aeb-4b30-bdfc-fef473802351 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd" status: 200 len: 1319 microversion: 2.1 time: 0.165459 Aug 02 09:21:20.277531 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 512/1048] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:20 2022] GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:21:21.299362 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ce2cafea-f3b6-41a0-9e35-e0e1cefc6e9e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:21.300053 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ce2cafea-f3b6-41a0-9e35-e0e1cefc6e9e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:21.306962 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ce2cafea-f3b6-41a0-9e35-e0e1cefc6e9e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:21.307404 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ce2cafea-f3b6-41a0-9e35-e0e1cefc6e9e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:21.308192 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ce2cafea-f3b6-41a0-9e35-e0e1cefc6e9e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:21.308612 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ce2cafea-f3b6-41a0-9e35-e0e1cefc6e9e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:21.460613 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ce2cafea-f3b6-41a0-9e35-e0e1cefc6e9e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:21.469295 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ce2cafea-f3b6-41a0-9e35-e0e1cefc6e9e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd" status: 200 len: 1507 microversion: 2.1 time: 0.175032 Aug 02 09:21:21.469936 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 537/1049] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:21 2022] GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd => generated 1507 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:21.491369 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-cd8df4e4-1e30-4ca8-ad6c-67495364afce tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5215b569-68ec-4075-824f-ffe3b115f824", "device": "/dev/sdb"}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:21:21.493901 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-cd8df4e4-1e30-4ca8-ad6c-67495364afce tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:21.501761 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cd8df4e4-1e30-4ca8-ad6c-67495364afce tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:21.502216 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cd8df4e4-1e30-4ca8-ad6c-67495364afce tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:21.503006 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cd8df4e4-1e30-4ca8-ad6c-67495364afce tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:21.503442 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-cd8df4e4-1e30-4ca8-ad6c-67495364afce tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:22.359160 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-cd8df4e4-1e30-4ca8-ad6c-67495364afce tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "POST /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.871797 Aug 02 09:21:22.359796 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 513/1050] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 2 09:21:21 2022] POST /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd/os-volume_attachments => generated 194 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:43.618188 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-599c8f88-7d4f-414d-a929-8cf5734faffe tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:43.618789 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-599c8f88-7d4f-414d-a929-8cf5734faffe tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:43.621038 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:43.621831 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=40 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:43.627128 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-599c8f88-7d4f-414d-a929-8cf5734faffe tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:43.627582 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-599c8f88-7d4f-414d-a929-8cf5734faffe tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:43.628405 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-599c8f88-7d4f-414d-a929-8cf5734faffe tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:43.628845 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-599c8f88-7d4f-414d-a929-8cf5734faffe tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:43.722420 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.objects.instance [None req-599c8f88-7d4f-414d-a929-8cf5734faffe tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lazy-loading 'services' on Instance uuid 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd {{(pid=118525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:21:43.966085 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-599c8f88-7d4f-414d-a929-8cf5734faffe tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "DELETE /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd/os-volume_attachments/5215b569-68ec-4075-824f-ffe3b115f824" status: 202 len: 0 microversion: 2.1 time: 0.351928 Aug 02 09:21:43.966663 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 538/1051] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 2 09:21:43 2022] DELETE /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd/os-volume_attachments/5215b569-68ec-4075-824f-ffe3b115f824 => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:21:46.152838 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-96e777fc-0e47-4637-b792-04c52141c41f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:46.153416 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-96e777fc-0e47-4637-b792-04c52141c41f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:46.156571 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=18 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:46.157240 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:21:46.162344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-96e777fc-0e47-4637-b792-04c52141c41f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:46.162789 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-96e777fc-0e47-4637-b792-04c52141c41f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:46.163549 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-96e777fc-0e47-4637-b792-04c52141c41f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:46.163978 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-96e777fc-0e47-4637-b792-04c52141c41f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:46.192241 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-96e777fc-0e47-4637-b792-04c52141c41f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd] Going to try to terminate instance {{(pid=118526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:21:46.549863 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-96e777fc-0e47-4637-b792-04c52141c41f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "DELETE /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd" status: 204 len: 0 microversion: 2.1 time: 0.400759 Aug 02 09:21:46.550549 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 514/1052] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:21:46 2022] DELETE /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:21:46.559970 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-fccac224-2c71-45e4-bc2f-6efa032dab9f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:46.560699 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-fccac224-2c71-45e4-bc2f-6efa032dab9f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:46.568486 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fccac224-2c71-45e4-bc2f-6efa032dab9f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:46.569072 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fccac224-2c71-45e4-bc2f-6efa032dab9f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:46.569867 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fccac224-2c71-45e4-bc2f-6efa032dab9f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:46.570301 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fccac224-2c71-45e4-bc2f-6efa032dab9f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:46.718302 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-fccac224-2c71-45e4-bc2f-6efa032dab9f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:46.726241 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-fccac224-2c71-45e4-bc2f-6efa032dab9f tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd" status: 200 len: 1513 microversion: 2.1 time: 0.170897 Aug 02 09:21:46.726821 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 539/1053] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:46 2022] GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd => generated 1513 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:47.749132 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-fb0e7cfe-eb6a-4e51-bcf9-c502c79bf3c1 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:47.749825 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-fb0e7cfe-eb6a-4e51-bcf9-c502c79bf3c1 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:47.756529 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fb0e7cfe-eb6a-4e51-bcf9-c502c79bf3c1 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:47.756977 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fb0e7cfe-eb6a-4e51-bcf9-c502c79bf3c1 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:47.757748 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fb0e7cfe-eb6a-4e51-bcf9-c502c79bf3c1 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:47.758186 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-fb0e7cfe-eb6a-4e51-bcf9-c502c79bf3c1 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:47.899133 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-fb0e7cfe-eb6a-4e51-bcf9-c502c79bf3c1 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:47.909832 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-fb0e7cfe-eb6a-4e51-bcf9-c502c79bf3c1 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd" status: 200 len: 1513 microversion: 2.1 time: 0.163135 Aug 02 09:21:47.909832 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 515/1054] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:47 2022] GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:48.930477 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-7fba414e-e85c-42aa-9943-dfcfb947822e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:48.934296 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-7fba414e-e85c-42aa-9943-dfcfb947822e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:48.939072 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7fba414e-e85c-42aa-9943-dfcfb947822e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:48.939530 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7fba414e-e85c-42aa-9943-dfcfb947822e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:48.943128 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7fba414e-e85c-42aa-9943-dfcfb947822e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:48.943128 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-7fba414e-e85c-42aa-9943-dfcfb947822e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:49.012151 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-af2a39fc-7539-4719-98d3-1cfc6f00a712 req-ef38134d-3395-4f9d-9f77-affcf08d16e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01e7bbb0-e9fb-4e13-81ab-5df09c1678cd", "name": "network-vif-deleted", "tag": "3212ab15-2ab1-46ed-8128-629127557e7f"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:21:49.023356 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-af2a39fc-7539-4719-98d3-1cfc6f00a712 req-ef38134d-3395-4f9d-9f77-affcf08d16e5 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:49.023799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-af2a39fc-7539-4719-98d3-1cfc6f00a712 req-ef38134d-3395-4f9d-9f77-affcf08d16e5 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:49.027428 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-7fba414e-e85c-42aa-9943-dfcfb947822e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a6a74b4d273744a1bad7637f6c7c6e23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '533a6226184d43a5b13c9da2c4a5d971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:21:49.036011 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-7fba414e-e85c-42aa-9943-dfcfb947822e tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd" status: 200 len: 1471 microversion: 2.1 time: 0.109470 Aug 02 09:21:49.036604 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 540/1055] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:48 2022] GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd => generated 1471 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:21:49.037160 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-af2a39fc-7539-4719-98d3-1cfc6f00a712 req-ef38134d-3395-4f9d-9f77-affcf08d16e5 service nova] Creating event network-vif-deleted:3212ab15-2ab1-46ed-8128-629127557e7f for instance 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd on hv-cinder-84599 Aug 02 09:21:49.042387 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-af2a39fc-7539-4719-98d3-1cfc6f00a712 req-ef38134d-3395-4f9d-9f77-affcf08d16e5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035186 Aug 02 09:21:49.043167 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 516/1056] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:21:50.058370 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-36fde9d7-23b5-4e16-b4f3-476c71d6c038 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:21:50.058973 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-36fde9d7-23b5-4e16-b4f3-476c71d6c038 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] [instance: 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:21:50.067159 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-36fde9d7-23b5-4e16-b4f3-476c71d6c038 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:50.067613 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-36fde9d7-23b5-4e16-b4f3-476c71d6c038 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:50.070516 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-36fde9d7-23b5-4e16-b4f3-476c71d6c038 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:21:50.072101 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-36fde9d7-23b5-4e16-b4f3-476c71d6c038 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:21:50.090383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-36fde9d7-23b5-4e16-b4f3-476c71d6c038 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] HTTP exception thrown: Instance 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd could not be found. Aug 02 09:21:50.090383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-36fde9d7-23b5-4e16-b4f3-476c71d6c038 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Request method failure captured: Aug 02 09:21:50.090383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd HTTP/1.1 Aug 02 09:21:50.090383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:21:50.090383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:21:50.090383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:21:50.090383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:21:50.090383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:21:50.090383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:21:50.090383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:21:50.090383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:21:50.090383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6Owv7n2v4-3F9IydLnCuvjyDq18gICWY6PZm8ioQEPCCyOOQd54wbvnVhn683dssfchFAC9B5mbO013f-8f8Au9LPZDqBEus41KfLCD5TJGEANw17cE8QEZBiKkpkassF3-ift4MFuwm53iHRWYHP8a_FumHrYwuPAyLgxIntgEDAXs Aug 02 09:21:50.090383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:21:50.090383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:21:50.090383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:21:50.090383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:21:50.090383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:21:50.090383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:21:50.090383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: 533a6226184d43a5b13c9da2c4a5d971 Aug 02 09:21:50.090383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1139804103 Aug 02 09:21:50.090383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:21:50.090383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:21:50.092507 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/533a6226184d43a5b13c9da2c4a5d971"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/533a6226184d43a5b13c9da2c4a5d971"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/533a6226184d43a5b13c9da2c4a5d971"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_533a6226184d43a5b13c9da2c4a5d971"}]}] Aug 02 09:21:50.092507 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-VolumesSnapshotTestJSON-1139804103 Aug 02 09:21:50.092507 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: 533a6226184d43a5b13c9da2c4a5d971 Aug 02 09:21:50.092507 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1139804103 Aug 02 09:21:50.092507 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-VolumesSnapshotTestJSON-1139804103-project Aug 02 09:21:50.092507 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:21:50.092507 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:21:50.092507 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: a6a74b4d273744a1bad7637f6c7c6e23 Aug 02 09:21:50.092507 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-VolumesSnapshotTestJSON-1139804103-project Aug 02 09:21:50.092507 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: > Aug 02 09:21:50.092507 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Instance 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd could not be found. Aug 02 09:21:50.092507 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': '01e7bbb0-e9fb-4e13-81ab-5df09c1678cd'} Aug 02 09:21:50.093514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:21:50.093514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:21:50.093514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:21:50.093514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:21:50.093514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:21:50.093514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:21:50.093514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:21:50.093514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:21:50.093514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:21:50.093514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:21:50.093514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd could not be found. Aug 02 09:21:50.093514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:21:50.093514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:21:50.093514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:21:50.093514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:21:50.093514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:21:50.093514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:21:50.093514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:21:50.093514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:21:50.093514 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:21:50.095270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:21:50.095270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:21:50.095270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:21:50.095270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:21:50.095270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:21:50.095270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:21:50.095270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:21:50.095270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd could not be found. Aug 02 09:21:50.095270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:21:50.095270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:21:50.095270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:21:50.095270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:21:50.095270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:21:50.095270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:21:50.095270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:21:50.095270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:21:50.095270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd could not be found. Aug 02 09:21:50.095270 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:21:50.097117 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-36fde9d7-23b5-4e16-b4f3-476c71d6c038 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] Returning 404 to user: Instance 01e7bbb0-e9fb-4e13-81ab-5df09c1678cd could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:21:50.097117 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-36fde9d7-23b5-4e16-b4f3-476c71d6c038 tempest-VolumesSnapshotTestJSON-1139804103 tempest-VolumesSnapshotTestJSON-1139804103-project] 10.222.0.20 "GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd" status: 404 len: 111 microversion: 2.1 time: 0.037296 Aug 02 09:21:50.097117 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 541/1057] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:21:50 2022] GET /compute/v2.1/servers/01e7bbb0-e9fb-4e13-81ab-5df09c1678cd => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:22:12.207180 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-c924c049-f270-4a24-8c6a-0a89c6393756 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:12.208452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-c924c049-f270-4a24-8c6a-0a89c6393756 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:12.209954 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=8 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:12.210985 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:12.211928 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:12.212082 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:12.218683 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c924c049-f270-4a24-8c6a-0a89c6393756 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:12.223520 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c924c049-f270-4a24-8c6a-0a89c6393756 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:12.223520 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c924c049-f270-4a24-8c6a-0a89c6393756 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:12.223520 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-c924c049-f270-4a24-8c6a-0a89c6393756 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:12.249214 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-c924c049-f270-4a24-8c6a-0a89c6393756 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Going to try to terminate instance {{(pid=118526) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:22:12.308307 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-ad70462e-d06f-427e-8e5d-84c86bf1d17a req-00a378de-0c5c-48c2-9380-1c39adf43665 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdfb67c8-1525-4398-adf6-120021432e20", "tag": "ab7cd2d2-0701-413b-b313-69afdf155eac"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:22:12.319414 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-ad70462e-d06f-427e-8e5d-84c86bf1d17a req-00a378de-0c5c-48c2-9380-1c39adf43665 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:12.319860 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-ad70462e-d06f-427e-8e5d-84c86bf1d17a req-00a378de-0c5c-48c2-9380-1c39adf43665 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:12.332367 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-ad70462e-d06f-427e-8e5d-84c86bf1d17a req-00a378de-0c5c-48c2-9380-1c39adf43665 service nova] Creating event network-changed:ab7cd2d2-0701-413b-b313-69afdf155eac for instance cdfb67c8-1525-4398-adf6-120021432e20 on hv-cinder-84599 Aug 02 09:22:12.338327 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-ad70462e-d06f-427e-8e5d-84c86bf1d17a req-00a378de-0c5c-48c2-9380-1c39adf43665 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133906 Aug 02 09:22:12.339352 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 542/1058] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:12.692183 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-c924c049-f270-4a24-8c6a-0a89c6393756 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20" status: 204 len: 0 microversion: 2.1 time: 0.489231 Aug 02 09:22:12.697385 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 517/1059] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:22:12 2022] DELETE /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:22:12.707591 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ac5a77c0-0bb5-452f-8b44-cf01e80ac0de tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:12.708717 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ac5a77c0-0bb5-452f-8b44-cf01e80ac0de tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:12.716324 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ac5a77c0-0bb5-452f-8b44-cf01e80ac0de tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:12.716831 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ac5a77c0-0bb5-452f-8b44-cf01e80ac0de tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:12.717959 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ac5a77c0-0bb5-452f-8b44-cf01e80ac0de tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:12.718355 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ac5a77c0-0bb5-452f-8b44-cf01e80ac0de tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:12.866458 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ac5a77c0-0bb5-452f-8b44-cf01e80ac0de tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:12.876482 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ac5a77c0-0bb5-452f-8b44-cf01e80ac0de tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20" status: 200 len: 1579 microversion: 2.1 time: 0.174586 Aug 02 09:22:12.877079 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 543/1060] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:12 2022] GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 => generated 1579 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:13.900021 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-43912f66-8281-4223-ba2a-3713d9b4bb12 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:13.900771 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-43912f66-8281-4223-ba2a-3713d9b4bb12 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:13.907953 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-43912f66-8281-4223-ba2a-3713d9b4bb12 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:13.908443 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-43912f66-8281-4223-ba2a-3713d9b4bb12 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:13.909348 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-43912f66-8281-4223-ba2a-3713d9b4bb12 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:13.909805 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-43912f66-8281-4223-ba2a-3713d9b4bb12 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:14.095369 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-43912f66-8281-4223-ba2a-3713d9b4bb12 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:14.098945 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-43912f66-8281-4223-ba2a-3713d9b4bb12 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20" status: 200 len: 1579 microversion: 2.1 time: 0.203813 Aug 02 09:22:14.099565 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 518/1061] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:13 2022] GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 => generated 1579 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:15.092089 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-e83303ee-f0fe-48f3-be13-0b09a262bbb0 req-c3726ee0-de41-49ce-827d-5d3e721272ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdfb67c8-1525-4398-adf6-120021432e20", "name": "network-vif-deleted", "tag": "ab7cd2d2-0701-413b-b313-69afdf155eac"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:22:15.104800 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-e83303ee-f0fe-48f3-be13-0b09a262bbb0 req-c3726ee0-de41-49ce-827d-5d3e721272ea service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:15.105182 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-e83303ee-f0fe-48f3-be13-0b09a262bbb0 req-c3726ee0-de41-49ce-827d-5d3e721272ea service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:15.119892 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-e83303ee-f0fe-48f3-be13-0b09a262bbb0 req-c3726ee0-de41-49ce-827d-5d3e721272ea service nova] Creating event network-vif-deleted:ab7cd2d2-0701-413b-b313-69afdf155eac for instance cdfb67c8-1525-4398-adf6-120021432e20 on hv-cinder-84599 Aug 02 09:22:15.145133 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-a8e98489-3baf-4609-8769-e11a1c274f4a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:15.145133 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-a8e98489-3baf-4609-8769-e11a1c274f4a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:15.146168 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-e83303ee-f0fe-48f3-be13-0b09a262bbb0 req-c3726ee0-de41-49ce-827d-5d3e721272ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037154 Aug 02 09:22:15.146168 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 544/1062] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:22:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:15.146344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a8e98489-3baf-4609-8769-e11a1c274f4a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:15.146344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a8e98489-3baf-4609-8769-e11a1c274f4a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:15.146344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a8e98489-3baf-4609-8769-e11a1c274f4a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:15.146344 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-a8e98489-3baf-4609-8769-e11a1c274f4a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:15.203754 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-a8e98489-3baf-4609-8769-e11a1c274f4a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:15.211806 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-a8e98489-3baf-4609-8769-e11a1c274f4a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20" status: 200 len: 1393 microversion: 2.1 time: 0.093940 Aug 02 09:22:15.213851 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 519/1063] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:15 2022] GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 => generated 1393 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:22:15.295197 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:22:15.295494 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Tue Aug 2 09:22:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:22:16.234974 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-e7b6cf10-9e93-4cd5-ba0f-bc325f9837fd tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:16.235684 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-e7b6cf10-9e93-4cd5-ba0f-bc325f9837fd tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:16.242671 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e7b6cf10-9e93-4cd5-ba0f-bc325f9837fd tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:16.243228 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e7b6cf10-9e93-4cd5-ba0f-bc325f9837fd tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:16.244013 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e7b6cf10-9e93-4cd5-ba0f-bc325f9837fd tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:16.244485 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e7b6cf10-9e93-4cd5-ba0f-bc325f9837fd tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:16.278172 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e7b6cf10-9e93-4cd5-ba0f-bc325f9837fd tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:16.279024 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e7b6cf10-9e93-4cd5-ba0f-bc325f9837fd tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:16.279190 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.objects.instance [None req-e7b6cf10-9e93-4cd5-ba0f-bc325f9837fd tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lazy-loading 'fault' on Instance uuid cdfb67c8-1525-4398-adf6-120021432e20 {{(pid=118525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:22:16.321982 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-e7b6cf10-9e93-4cd5-ba0f-bc325f9837fd tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:16.329896 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-e7b6cf10-9e93-4cd5-ba0f-bc325f9837fd tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20" status: 200 len: 1231 microversion: 2.1 time: 0.099611 Aug 02 09:22:16.330467 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 545/1064] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:16 2022] GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:17.351797 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-ae166911-eff1-49f7-8f87-1fdfd8eafd5a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:17.352397 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-ae166911-eff1-49f7-8f87-1fdfd8eafd5a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cdfb67c8-1525-4398-adf6-120021432e20] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:17.359201 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ae166911-eff1-49f7-8f87-1fdfd8eafd5a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:17.359643 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ae166911-eff1-49f7-8f87-1fdfd8eafd5a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:17.360446 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ae166911-eff1-49f7-8f87-1fdfd8eafd5a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:17.360882 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ae166911-eff1-49f7-8f87-1fdfd8eafd5a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:17.374845 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-ae166911-eff1-49f7-8f87-1fdfd8eafd5a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] HTTP exception thrown: Instance cdfb67c8-1525-4398-adf6-120021432e20 could not be found. Aug 02 09:22:17.378109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-ae166911-eff1-49f7-8f87-1fdfd8eafd5a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Request method failure captured: Aug 02 09:22:17.378109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 HTTP/1.1 Aug 02 09:22:17.378109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:22:17.378109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:22:17.378109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:22:17.378109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:22:17.378109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:22:17.378109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:22:17.378109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:22:17.378109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:22:17.378109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6Or9j-cQzxFAAB1xBmv_bY_mRvljzv7nsSioCNaI1OGnkB6STrdlAlH5TAjtrlpHrQIu9d8A2YEEmh2wzTuRN7Vb6j4uWiaX0a2HO94lGUsCKCZWP7V0SJXCiQV2Lh4Rtd7IJx4Pp0WLja2tbiIhH3e67gkC1faskQi8YHy99F0xJQ0 Aug 02 09:22:17.378109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:22:17.378109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:22:17.378109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:22:17.378109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:22:17.378109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:22:17.378109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:22:17.378109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: 8e8d4b340fc54e639758d911a5ab16a7 Aug 02 09:22:17.378109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-TestVolumeBootPattern-657612348 Aug 02 09:22:17.378109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:22:17.378109 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:22:17.380550 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8e8d4b340fc54e639758d911a5ab16a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8e8d4b340fc54e639758d911a5ab16a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8e8d4b340fc54e639758d911a5ab16a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8e8d4b340fc54e639758d911a5ab16a7"}]}] Aug 02 09:22:17.380550 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-TestVolumeBootPattern-657612348 Aug 02 09:22:17.380550 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: 8e8d4b340fc54e639758d911a5ab16a7 Aug 02 09:22:17.380550 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-TestVolumeBootPattern-657612348 Aug 02 09:22:17.380550 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-TestVolumeBootPattern-657612348-project Aug 02 09:22:17.380550 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:22:17.380550 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:22:17.380550 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: c0a2b49114e0458f9625de698cc89861 Aug 02 09:22:17.380550 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-TestVolumeBootPattern-657612348-project Aug 02 09:22:17.380550 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:22:17.380550 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Instance cdfb67c8-1525-4398-adf6-120021432e20 could not be found. Aug 02 09:22:17.380550 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'id': 'cdfb67c8-1525-4398-adf6-120021432e20'} Aug 02 09:22:17.381960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:22:17.381960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:22:17.381960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:22:17.381960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:22:17.381960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:22:17.381960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:22:17.381960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:22:17.381960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:22:17.381960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:22:17.381960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:22:17.381960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdfb67c8-1525-4398-adf6-120021432e20 could not be found. Aug 02 09:22:17.381960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:22:17.381960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:22:17.381960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:22:17.381960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:22:17.381960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:22:17.381960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:22:17.381960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:22:17.381960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:22:17.381960 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:22:17.384836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:22:17.384836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:22:17.384836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:22:17.384836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:22:17.384836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:22:17.384836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:22:17.384836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:22:17.384836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdfb67c8-1525-4398-adf6-120021432e20 could not be found. Aug 02 09:22:17.384836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:22:17.384836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:22:17.384836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:22:17.384836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:22:17.384836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:22:17.384836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:22:17.384836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:22:17.384836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:22:17.384836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdfb67c8-1525-4398-adf6-120021432e20 could not be found. Aug 02 09:22:17.384836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:22:17.386350 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-ae166911-eff1-49f7-8f87-1fdfd8eafd5a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Returning 404 to user: Instance cdfb67c8-1525-4398-adf6-120021432e20 could not be found. {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:22:17.386350 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-ae166911-eff1-49f7-8f87-1fdfd8eafd5a tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20" status: 404 len: 111 microversion: 2.1 time: 0.030235 Aug 02 09:22:17.386350 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 520/1065] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:17 2022] GET /compute/v2.1/servers/cdfb67c8-1525-4398-adf6-120021432e20 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:22:20.825530 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-19a73874-1ae0-4257-9b92-f1fb81b8f725 req-4239d09e-898d-414e-8ebf-acde4c876bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c", "tag": "ec5c5fb4-4216-49ff-9a57-3adc12d6b9f9"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:22:20.826677 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-3ffcc198-e578-487a-9fa6-42008a450719 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:20.827452 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-3ffcc198-e578-487a-9fa6-42008a450719 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:20.835081 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3ffcc198-e578-487a-9fa6-42008a450719 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:20.835459 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-19a73874-1ae0-4257-9b92-f1fb81b8f725 req-4239d09e-898d-414e-8ebf-acde4c876bc8 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:20.835749 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3ffcc198-e578-487a-9fa6-42008a450719 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:20.836114 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-19a73874-1ae0-4257-9b92-f1fb81b8f725 req-4239d09e-898d-414e-8ebf-acde4c876bc8 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:20.838476 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3ffcc198-e578-487a-9fa6-42008a450719 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:20.839235 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3ffcc198-e578-487a-9fa6-42008a450719 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:20.849358 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-19a73874-1ae0-4257-9b92-f1fb81b8f725 req-4239d09e-898d-414e-8ebf-acde4c876bc8 service nova] Creating event network-changed:ec5c5fb4-4216-49ff-9a57-3adc12d6b9f9 for instance 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c on hv-cinder-84599 Aug 02 09:22:20.855575 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-19a73874-1ae0-4257-9b92-f1fb81b8f725 req-4239d09e-898d-414e-8ebf-acde4c876bc8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033613 Aug 02 09:22:20.856811 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 521/1066] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:20.870878 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-3ffcc198-e578-487a-9fa6-42008a450719 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Going to try to terminate instance {{(pid=118525) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:22:21.242231 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-3ffcc198-e578-487a-9fa6-42008a450719 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 204 len: 0 microversion: 2.1 time: 0.421538 Aug 02 09:22:21.243535 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 546/1067] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:22:20 2022] DELETE /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:22:21.252849 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-3b9f648a-1cd4-4986-b8ce-7da9187a49ae tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:21.253597 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-3b9f648a-1cd4-4986-b8ce-7da9187a49ae tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:21.261110 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3b9f648a-1cd4-4986-b8ce-7da9187a49ae tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:21.265639 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3b9f648a-1cd4-4986-b8ce-7da9187a49ae tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:21.265639 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3b9f648a-1cd4-4986-b8ce-7da9187a49ae tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:21.265639 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3b9f648a-1cd4-4986-b8ce-7da9187a49ae tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:21.442936 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-3b9f648a-1cd4-4986-b8ce-7da9187a49ae tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:21.451163 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-3b9f648a-1cd4-4986-b8ce-7da9187a49ae tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1579 microversion: 2.1 time: 0.202739 Aug 02 09:22:21.451740 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 522/1068] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:21 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1579 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:22.476860 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ec861cbf-6d55-4b33-87ec-bc8a7e074d93 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:22.477625 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ec861cbf-6d55-4b33-87ec-bc8a7e074d93 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:22.484556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ec861cbf-6d55-4b33-87ec-bc8a7e074d93 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:22.485012 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ec861cbf-6d55-4b33-87ec-bc8a7e074d93 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:22.485806 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ec861cbf-6d55-4b33-87ec-bc8a7e074d93 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:22.486244 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ec861cbf-6d55-4b33-87ec-bc8a7e074d93 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:22.639211 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-ec861cbf-6d55-4b33-87ec-bc8a7e074d93 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:22.646978 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ec861cbf-6d55-4b33-87ec-bc8a7e074d93 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1579 microversion: 2.1 time: 0.175225 Aug 02 09:22:22.647558 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 547/1069] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:22 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1579 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:23.669257 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-af38f7b0-8d7e-4ab3-8448-f51dfa4e2f9b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:23.670424 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-af38f7b0-8d7e-4ab3-8448-f51dfa4e2f9b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:23.676672 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-af38f7b0-8d7e-4ab3-8448-f51dfa4e2f9b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:23.677120 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-af38f7b0-8d7e-4ab3-8448-f51dfa4e2f9b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:23.677891 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-af38f7b0-8d7e-4ab3-8448-f51dfa4e2f9b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:23.678338 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-af38f7b0-8d7e-4ab3-8448-f51dfa4e2f9b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:23.814419 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-af38f7b0-8d7e-4ab3-8448-f51dfa4e2f9b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:23.822861 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-af38f7b0-8d7e-4ab3-8448-f51dfa4e2f9b tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1579 microversion: 2.1 time: 0.157658 Aug 02 09:22:23.823474 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 523/1070] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:23 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1579 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:24.844494 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-e4fc05a1-89e5-47bb-863e-5a3cfa4a748e tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:24.845180 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-e4fc05a1-89e5-47bb-863e-5a3cfa4a748e tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:24.852571 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e4fc05a1-89e5-47bb-863e-5a3cfa4a748e tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:24.853097 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e4fc05a1-89e5-47bb-863e-5a3cfa4a748e tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:24.853921 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e4fc05a1-89e5-47bb-863e-5a3cfa4a748e tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:24.854367 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-e4fc05a1-89e5-47bb-863e-5a3cfa4a748e tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:24.998345 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-e4fc05a1-89e5-47bb-863e-5a3cfa4a748e tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:25.006131 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-e4fc05a1-89e5-47bb-863e-5a3cfa4a748e tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1460 microversion: 2.1 time: 0.165638 Aug 02 09:22:25.006696 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 548/1071] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:24 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1460 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:26.028029 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-feeb4f4b-ca7f-4a7a-9422-fa79fb9887a2 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:26.028758 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-feeb4f4b-ca7f-4a7a-9422-fa79fb9887a2 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:26.036000 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-feeb4f4b-ca7f-4a7a-9422-fa79fb9887a2 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:26.036515 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-feeb4f4b-ca7f-4a7a-9422-fa79fb9887a2 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:26.037297 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-feeb4f4b-ca7f-4a7a-9422-fa79fb9887a2 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:26.037840 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-feeb4f4b-ca7f-4a7a-9422-fa79fb9887a2 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:26.189538 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-feeb4f4b-ca7f-4a7a-9422-fa79fb9887a2 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:26.197647 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-feeb4f4b-ca7f-4a7a-9422-fa79fb9887a2 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1460 microversion: 2.1 time: 0.174340 Aug 02 09:22:26.202493 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 524/1072] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:26 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1460 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:26.283901 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-fad24f68-778b-4e96-a06d-62236642d270 req-12ed5d5d-8918-4c97-a5cd-be3f9b889aab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c", "name": "network-vif-deleted", "tag": "ec5c5fb4-4216-49ff-9a57-3adc12d6b9f9"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:22:26.295767 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-fad24f68-778b-4e96-a06d-62236642d270 req-12ed5d5d-8918-4c97-a5cd-be3f9b889aab service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:26.296294 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-fad24f68-778b-4e96-a06d-62236642d270 req-12ed5d5d-8918-4c97-a5cd-be3f9b889aab service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:26.309500 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-fad24f68-778b-4e96-a06d-62236642d270 req-12ed5d5d-8918-4c97-a5cd-be3f9b889aab service nova] Creating event network-vif-deleted:ec5c5fb4-4216-49ff-9a57-3adc12d6b9f9 for instance 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c on hv-cinder-84599 Aug 02 09:22:26.315074 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-fad24f68-778b-4e96-a06d-62236642d270 req-12ed5d5d-8918-4c97-a5cd-be3f9b889aab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034983 Aug 02 09:22:26.315681 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 549/1073] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:27.219844 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-eb6c546b-f631-4dfa-88f2-54731a390e00 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:27.220402 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-eb6c546b-f631-4dfa-88f2-54731a390e00 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:27.226951 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-eb6c546b-f631-4dfa-88f2-54731a390e00 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:27.227413 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-eb6c546b-f631-4dfa-88f2-54731a390e00 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:27.228721 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-eb6c546b-f631-4dfa-88f2-54731a390e00 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:27.229168 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-eb6c546b-f631-4dfa-88f2-54731a390e00 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:27.261438 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-eb6c546b-f631-4dfa-88f2-54731a390e00 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:27.261896 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-eb6c546b-f631-4dfa-88f2-54731a390e00 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:27.262382 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.objects.instance [None req-eb6c546b-f631-4dfa-88f2-54731a390e00 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lazy-loading 'fault' on Instance uuid 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c {{(pid=118526) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:22:27.313051 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-eb6c546b-f631-4dfa-88f2-54731a390e00 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c0a2b49114e0458f9625de698cc89861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e8d4b340fc54e639758d911a5ab16a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:27.322513 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-eb6c546b-f631-4dfa-88f2-54731a390e00 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 200 len: 1231 microversion: 2.1 time: 0.105864 Aug 02 09:22:27.323342 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 525/1074] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:27 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 1231 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:28.345385 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4ac2b861-43d9-445d-afb1-603ad9a04a98 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:28.346117 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-4ac2b861-43d9-445d-afb1-603ad9a04a98 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:28.352660 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4ac2b861-43d9-445d-afb1-603ad9a04a98 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:28.353212 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4ac2b861-43d9-445d-afb1-603ad9a04a98 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:28.354398 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4ac2b861-43d9-445d-afb1-603ad9a04a98 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:28.354842 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-4ac2b861-43d9-445d-afb1-603ad9a04a98 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:28.370189 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-4ac2b861-43d9-445d-afb1-603ad9a04a98 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] HTTP exception thrown: Instance 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c could not be found. Aug 02 09:22:28.371853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4ac2b861-43d9-445d-afb1-603ad9a04a98 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Request method failure captured: Aug 02 09:22:28.371853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c HTTP/1.1 Aug 02 09:22:28.371853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:22:28.371853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:22:28.371853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:22:28.371853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:22:28.371853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:22:28.371853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:22:28.371853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:22:28.371853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:22:28.371853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6Or9j-cQzxFAAB1xBmv_bY_mRvljzv7nsSioCNaI1OGnkB6STrdlAlH5TAjtrlpHrQIu9d8A2YEEmh2wzTuRN7Vb6j4uWiaX0a2HO94lGUsCKCZWP7V0SJXCiQV2Lh4Rtd7IJx4Pp0WLja2tbiIhH3e67gkC1faskQi8YHy99F0xJQ0 Aug 02 09:22:28.371853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:22:28.371853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:22:28.371853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:22:28.371853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:22:28.371853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:22:28.371853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:22:28.371853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: 8e8d4b340fc54e639758d911a5ab16a7 Aug 02 09:22:28.371853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-TestVolumeBootPattern-657612348 Aug 02 09:22:28.371853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:22:28.371853 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:22:28.374463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8e8d4b340fc54e639758d911a5ab16a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8e8d4b340fc54e639758d911a5ab16a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8e8d4b340fc54e639758d911a5ab16a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8e8d4b340fc54e639758d911a5ab16a7"}]}] Aug 02 09:22:28.374463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-TestVolumeBootPattern-657612348 Aug 02 09:22:28.374463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: 8e8d4b340fc54e639758d911a5ab16a7 Aug 02 09:22:28.374463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-TestVolumeBootPattern-657612348 Aug 02 09:22:28.374463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-TestVolumeBootPattern-657612348-project Aug 02 09:22:28.374463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:22:28.374463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:22:28.374463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: c0a2b49114e0458f9625de698cc89861 Aug 02 09:22:28.374463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-TestVolumeBootPattern-657612348-project Aug 02 09:22:28.374463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: > Aug 02 09:22:28.374463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Instance 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c could not be found. Aug 02 09:22:28.374463 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': '9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c'} Aug 02 09:22:28.375851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:22:28.375851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:22:28.375851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:22:28.375851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:22:28.375851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:22:28.375851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:22:28.375851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:22:28.375851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:22:28.375851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:22:28.375851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:22:28.375851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c could not be found. Aug 02 09:22:28.375851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:22:28.375851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:22:28.375851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:22:28.375851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:22:28.375851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:22:28.375851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:22:28.375851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:22:28.375851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:22:28.375851 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:22:28.379992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:22:28.379992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:22:28.379992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:22:28.379992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:22:28.379992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:22:28.379992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:22:28.379992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:22:28.379992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c could not be found. Aug 02 09:22:28.379992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:22:28.379992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:22:28.379992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:22:28.379992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:22:28.379992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:22:28.379992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:22:28.379992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:22:28.379992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:22:28.379992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c could not be found. Aug 02 09:22:28.379992 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:22:28.382948 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-4ac2b861-43d9-445d-afb1-603ad9a04a98 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Returning 404 to user: Instance 9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:22:28.382948 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-4ac2b861-43d9-445d-afb1-603ad9a04a98 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c" status: 404 len: 111 microversion: 2.1 time: 0.032703 Aug 02 09:22:28.382948 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 550/1075] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:28 2022] GET /compute/v2.1/servers/9f0f3c81-06fa-4ea4-b8be-c8cce3be0c8c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:22:28.999629 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-986d9d17-922a-4684-bdad-5a79cbb65637 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:29.000266 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-986d9d17-922a-4684-bdad-5a79cbb65637 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:29.007654 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-986d9d17-922a-4684-bdad-5a79cbb65637 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:29.008225 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-986d9d17-922a-4684-bdad-5a79cbb65637 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:29.009138 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-986d9d17-922a-4684-bdad-5a79cbb65637 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:29.010037 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-986d9d17-922a-4684-bdad-5a79cbb65637 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:29.025406 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-986d9d17-922a-4684-bdad-5a79cbb65637 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] HTTP exception thrown: Instance cee14a35-0425-48c3-9e4e-efed2fdd23a1 could not be found. Aug 02 09:22:29.027779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-986d9d17-922a-4684-bdad-5a79cbb65637 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Request method failure captured: Aug 02 09:22:29.027779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: DELETE /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 HTTP/1.1 Aug 02 09:22:29.027779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:22:29.027779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:22:29.027779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:22:29.027779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:22:29.027779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:22:29.027779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:22:29.027779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:22:29.027779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:22:29.027779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6Or9j-cQzxFAAB1xBmv_bY_mRvljzv7nsSioCNaI1OGnkB6STrdlAlH5TAjtrlpHrQIu9d8A2YEEmh2wzTuRN7Vb6j4uWiaX0a2HO94lGUsCKCZWP7V0SJXCiQV2Lh4Rtd7IJx4Pp0WLja2tbiIhH3e67gkC1faskQi8YHy99F0xJQ0 Aug 02 09:22:29.027779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:22:29.027779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:22:29.027779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:22:29.027779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:22:29.027779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:22:29.027779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:22:29.027779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: 8e8d4b340fc54e639758d911a5ab16a7 Aug 02 09:22:29.027779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-TestVolumeBootPattern-657612348 Aug 02 09:22:29.027779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:22:29.027779 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:22:29.029387 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8e8d4b340fc54e639758d911a5ab16a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8e8d4b340fc54e639758d911a5ab16a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8e8d4b340fc54e639758d911a5ab16a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8e8d4b340fc54e639758d911a5ab16a7"}]}] Aug 02 09:22:29.029387 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-TestVolumeBootPattern-657612348 Aug 02 09:22:29.029387 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: 8e8d4b340fc54e639758d911a5ab16a7 Aug 02 09:22:29.029387 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-TestVolumeBootPattern-657612348 Aug 02 09:22:29.029387 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-TestVolumeBootPattern-657612348-project Aug 02 09:22:29.029387 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:22:29.029387 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:22:29.029387 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: c0a2b49114e0458f9625de698cc89861 Aug 02 09:22:29.029387 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-TestVolumeBootPattern-657612348-project Aug 02 09:22:29.029387 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:22:29.029387 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Instance cee14a35-0425-48c3-9e4e-efed2fdd23a1 could not be found. Aug 02 09:22:29.029387 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'id': 'cee14a35-0425-48c3-9e4e-efed2fdd23a1'} Aug 02 09:22:29.030234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:22:29.030234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:22:29.030234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:22:29.030234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:22:29.030234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:22:29.030234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:22:29.030234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:22:29.030234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:22:29.030234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:22:29.030234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:22:29.030234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cee14a35-0425-48c3-9e4e-efed2fdd23a1 could not be found. Aug 02 09:22:29.030234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:22:29.030234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:22:29.030234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:22:29.030234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:22:29.030234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:22:29.030234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:22:29.030234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:22:29.030234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:22:29.030234 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:22:29.032427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:22:29.032427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 02 09:22:29.032427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 02 09:22:29.032427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 02 09:22:29.032427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 02 09:22:29.032427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:22:29.032427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:22:29.032427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:22:29.032427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:22:29.032427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cee14a35-0425-48c3-9e4e-efed2fdd23a1 could not be found. Aug 02 09:22:29.032427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:22:29.032427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:22:29.032427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:22:29.032427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:22:29.032427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:22:29.032427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:22:29.032427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:22:29.032427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:22:29.032427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cee14a35-0425-48c3-9e4e-efed2fdd23a1 could not be found. Aug 02 09:22:29.032427 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:22:29.034926 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-986d9d17-922a-4684-bdad-5a79cbb65637 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Returning 404 to user: Instance cee14a35-0425-48c3-9e4e-efed2fdd23a1 could not be found. {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:22:29.034926 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-986d9d17-922a-4684-bdad-5a79cbb65637 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 404 len: 111 microversion: 2.1 time: 0.036737 Aug 02 09:22:29.034926 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 526/1076] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:22:28 2022] DELETE /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:22:29.040076 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d017051f-cac4-4a94-ac22-28005567ae07 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:29.041619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-d017051f-cac4-4a94-ac22-28005567ae07 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] [instance: cee14a35-0425-48c3-9e4e-efed2fdd23a1] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:29.047880 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d017051f-cac4-4a94-ac22-28005567ae07 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:29.048397 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d017051f-cac4-4a94-ac22-28005567ae07 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:29.049202 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d017051f-cac4-4a94-ac22-28005567ae07 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:29.049976 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d017051f-cac4-4a94-ac22-28005567ae07 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:29.067965 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.wsgi [None req-d017051f-cac4-4a94-ac22-28005567ae07 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] HTTP exception thrown: Instance cee14a35-0425-48c3-9e4e-efed2fdd23a1 could not be found. Aug 02 09:22:29.069538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d017051f-cac4-4a94-ac22-28005567ae07 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Request method failure captured: Aug 02 09:22:29.069538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: request: GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 HTTP/1.1 Aug 02 09:22:29.069538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept: application/json Aug 02 09:22:29.069538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Accept-Encoding: identity Aug 02 09:22:29.069538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Connection: close Aug 02 09:22:29.069538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Length: 0 Aug 02 09:22:29.069538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Content-Type: application/json Aug 02 09:22:29.069538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Host: 10.222.0.20 Aug 02 09:22:29.069538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Openstack-System-Scope: None Aug 02 09:22:29.069538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: User-Agent: python-urllib3/1.26.10 Aug 02 09:22:29.069538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Auth-Token: gAAAAABi6Or9j-cQzxFAAB1xBmv_bY_mRvljzv7nsSioCNaI1OGnkB6STrdlAlH5TAjtrlpHrQIu9d8A2YEEmh2wzTuRN7Vb6j4uWiaX0a2HO94lGUsCKCZWP7V0SJXCiQV2Lh4Rtd7IJx4Pp0WLja2tbiIhH3e67gkC1faskQi8YHy99F0xJQ0 Aug 02 09:22:29.069538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Id: None Aug 02 09:22:29.069538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Domain-Name: None Aug 02 09:22:29.069538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Identity-Status: Confirmed Aug 02 09:22:29.069538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Is-Admin-Project: True Aug 02 09:22:29.069538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Id: default Aug 02 09:22:29.069538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Domain-Name: Default Aug 02 09:22:29.069538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Id: 8e8d4b340fc54e639758d911a5ab16a7 Aug 02 09:22:29.069538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Project-Name: tempest-TestVolumeBootPattern-657612348 Aug 02 09:22:29.069538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Role: member,reader Aug 02 09:22:29.069538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Roles: member,reader Aug 02 09:22:29.071191 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8e8d4b340fc54e639758d911a5ab16a7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/8e8d4b340fc54e639758d911a5ab16a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/8e8d4b340fc54e639758d911a5ab16a7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_8e8d4b340fc54e639758d911a5ab16a7"}]}] Aug 02 09:22:29.071191 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant: tempest-TestVolumeBootPattern-657612348 Aug 02 09:22:29.071191 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Id: 8e8d4b340fc54e639758d911a5ab16a7 Aug 02 09:22:29.071191 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-Tenant-Name: tempest-TestVolumeBootPattern-657612348 Aug 02 09:22:29.071191 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User: tempest-TestVolumeBootPattern-657612348-project Aug 02 09:22:29.071191 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Id: default Aug 02 09:22:29.071191 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Domain-Name: Default Aug 02 09:22:29.071191 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Id: c0a2b49114e0458f9625de698cc89861 Aug 02 09:22:29.071191 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: X-User-Name: tempest-TestVolumeBootPattern-657612348-project Aug 02 09:22:29.071191 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: method: > Aug 02 09:22:29.071191 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: exception: Instance cee14a35-0425-48c3-9e4e-efed2fdd23a1 could not be found. Aug 02 09:22:29.071191 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: action_args: {'id': 'cee14a35-0425-48c3-9e4e-efed2fdd23a1'} Aug 02 09:22:29.072144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:22:29.072144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:22:29.072144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:22:29.072144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:22:29.072144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:22:29.072144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:22:29.072144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:22:29.072144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:22:29.072144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:22:29.072144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:22:29.072144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cee14a35-0425-48c3-9e4e-efed2fdd23a1 could not be found. Aug 02 09:22:29.072144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:22:29.072144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:22:29.072144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:22:29.072144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:22:29.072144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:22:29.072144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:22:29.072144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:22:29.072144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:22:29.072144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:22:29.073754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:22:29.073754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:22:29.073754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:22:29.073754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:22:29.073754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:22:29.073754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:22:29.073754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:22:29.073754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cee14a35-0425-48c3-9e4e-efed2fdd23a1 could not be found. Aug 02 09:22:29.073754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:22:29.073754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:22:29.073754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:22:29.073754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:22:29.073754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:22:29.073754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:22:29.073754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:22:29.073754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:22:29.073754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cee14a35-0425-48c3-9e4e-efed2fdd23a1 could not be found. Aug 02 09:22:29.073754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: ERROR nova.api.openstack.wsgi Aug 02 09:22:29.074900 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d017051f-cac4-4a94-ac22-28005567ae07 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Returning 404 to user: Instance cee14a35-0425-48c3-9e4e-efed2fdd23a1 could not be found. {{(pid=118525) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:22:29.074900 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-d017051f-cac4-4a94-ac22-28005567ae07 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1" status: 404 len: 111 microversion: 2.1 time: 0.035832 Aug 02 09:22:29.074900 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 551/1077] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:29 2022] GET /compute/v2.1/servers/cee14a35-0425-48c3-9e4e-efed2fdd23a1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:22:30.662252 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-fc1cf423-3223-4596-b6f2-cb681f6a9f01 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] Calling method '.version_select at 0x7ffb9aaa68b0>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:30.811760 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-fc1cf423-3223-4596-b6f2-cb681f6a9f01 tempest-TestVolumeBootPattern-657612348 tempest-TestVolumeBootPattern-657612348-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1068068850" status: 202 len: 0 microversion: 2.1 time: 0.153394 Aug 02 09:22:30.812377 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 527/1078] 10.222.0.20 () {58 vars in 1263 bytes} [Tue Aug 2 09:22:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1068068850 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:22:56.751364 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-06a6762a-7bcd-4bf6-a243-d130dbd818fa tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Action: 'create', calling method: .version_select at 0x7ffb9ac330d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-786949273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIU3kZkeMGZQFXk0b+3tfd676ZNQXiCo6tMVJA8V7CEiz6nwreTWG3l1t0znzrIKKS/hyKTACGpRkipet1CEFczEYadXRdUCPu7MdgvdEkWtxp2V18WoYhP6LYvTUXJm/g=="}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:22:56.757645 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:56.758460 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:56.769667 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-06a6762a-7bcd-4bf6-a243-d130dbd818fa tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Getting quotas for project ed8821168eca41338809f59eda063b63. Resources: {'key_pairs'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:22:56.774094 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.quota [None req-06a6762a-7bcd-4bf6-a243-d130dbd818fa tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Getting quotas for user 88bb10103dc8467793345f8fb164ecbb and project ed8821168eca41338809f59eda063b63. Resources: {'key_pairs'} {{(pid=118525) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:22:56.925282 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-06a6762a-7bcd-4bf6-a243-d130dbd818fa tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.177912 Aug 02 09:22:56.925928 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 552/1079] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 2 09:22:56 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:22:56.975910 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:56.977480 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:22:56.982479 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-9491163b-4113-438e-bc7e-9199da268dca tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1590854203", "imageRef": "b53b64ee-338c-442f-b108-f35b930332be", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-786949273", "networks": [{"uuid": "a5f5b0e2-7dd3-4cef-81de-f8db0aa7f927"}]}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:22:57.038389 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.network.neutron [None req-9491163b-4113-438e-bc7e-9199da268dca tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] validate_networks() for [('a5f5b0e2-7dd3-4cef-81de-f8db0aa7f927', None, None, None, None, None)] {{(pid=118526) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 02 09:22:57.538619 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-9491163b-4113-438e-bc7e-9199da268dca tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Flavor limits 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 02 09:22:57.539034 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-9491163b-4113-438e-bc7e-9199da268dca tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Image limits 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 02 09:22:57.539661 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-9491163b-4113-438e-bc7e-9199da268dca tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Flavor pref 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 02 09:22:57.540054 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-9491163b-4113-438e-bc7e-9199da268dca tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Image pref 0:0:0 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 02 09:22:57.540584 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.virt.hardware [None req-9491163b-4113-438e-bc7e-9199da268dca tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118526) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 02 09:22:57.549441 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9491163b-4113-438e-bc7e-9199da268dca tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:57.549877 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9491163b-4113-438e-bc7e-9199da268dca tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:57.550662 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9491163b-4113-438e-bc7e-9199da268dca tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:57.551089 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9491163b-4113-438e-bc7e-9199da268dca tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:57.568781 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-9491163b-4113-438e-bc7e-9199da268dca tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Getting quotas for project ed8821168eca41338809f59eda063b63. Resources: {'cores', 'ram', 'instances'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 02 09:22:57.573423 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.quota [None req-9491163b-4113-438e-bc7e-9199da268dca tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Getting quotas for user 88bb10103dc8467793345f8fb164ecbb and project ed8821168eca41338809f59eda063b63. Resources: {'cores', 'ram', 'instances'} {{(pid=118526) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 02 09:22:57.585167 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-9491163b-4113-438e-bc7e-9199da268dca tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Going to run 1 instances... {{(pid=118526) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 02 09:22:57.587455 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-9491163b-4113-438e-bc7e-9199da268dca tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b53b64ee-338c-442f-b108-f35b930332be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118526) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 02 09:22:57.738591 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-9491163b-4113-438e-bc7e-9199da268dca tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.764046 Aug 02 09:22:57.739970 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 528/1080] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 2 09:22:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 02 09:22:57.751820 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-fe5f4ca7-5792-453c-9fe1-42bffea21cf2 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:57.752498 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-fe5f4ca7-5792-453c-9fe1-42bffea21cf2 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:57.810308 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-fe5f4ca7-5792-453c-9fe1-42bffea21cf2 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:57.819053 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-fe5f4ca7-5792-453c-9fe1-42bffea21cf2 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1258 microversion: 2.1 time: 0.071784 Aug 02 09:22:57.819670 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 553/1081] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:57 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:58.841486 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-21197b3d-ac4a-4482-bf7e-df92e9b2a15b tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:58.842090 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-21197b3d-ac4a-4482-bf7e-df92e9b2a15b tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:58.900092 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-21197b3d-ac4a-4482-bf7e-df92e9b2a15b tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:22:58.907833 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-21197b3d-ac4a-4482-bf7e-df92e9b2a15b tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1258 microversion: 2.1 time: 0.071599 Aug 02 09:22:58.908424 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 529/1082] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:58 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1258 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:22:59.934078 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-c70ae2e7-a32d-4889-8bef-ddd89a253665 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:22:59.934729 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-c70ae2e7-a32d-4889-8bef-ddd89a253665 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:22:59.942333 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c70ae2e7-a32d-4889-8bef-ddd89a253665 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:59.942789 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c70ae2e7-a32d-4889-8bef-ddd89a253665 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:22:59.943645 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c70ae2e7-a32d-4889-8bef-ddd89a253665 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:22:59.944016 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c70ae2e7-a32d-4889-8bef-ddd89a253665 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:00.017874 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-c70ae2e7-a32d-4889-8bef-ddd89a253665 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:00.026354 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-c70ae2e7-a32d-4889-8bef-ddd89a253665 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1310 microversion: 2.1 time: 0.096381 Aug 02 09:23:00.036247 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 554/1083] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:22:59 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1310 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:01.050149 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-bef826c8-ec59-4830-b4d8-63711161f473 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:01.050983 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-bef826c8-ec59-4830-b4d8-63711161f473 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:01.058698 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bef826c8-ec59-4830-b4d8-63711161f473 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:01.059271 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bef826c8-ec59-4830-b4d8-63711161f473 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:01.060725 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bef826c8-ec59-4830-b4d8-63711161f473 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:01.061895 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-bef826c8-ec59-4830-b4d8-63711161f473 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:01.291856 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-bef826c8-ec59-4830-b4d8-63711161f473 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:01.301163 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-bef826c8-ec59-4830-b4d8-63711161f473 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1358 microversion: 2.1 time: 0.255527 Aug 02 09:23:01.301921 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 530/1084] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:01 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:02.323110 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-823bb87f-165a-4bdf-98ce-7e18b3d4b1b0 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:02.323741 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-823bb87f-165a-4bdf-98ce-7e18b3d4b1b0 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:02.330647 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-823bb87f-165a-4bdf-98ce-7e18b3d4b1b0 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:02.331087 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-823bb87f-165a-4bdf-98ce-7e18b3d4b1b0 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:02.331859 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-823bb87f-165a-4bdf-98ce-7e18b3d4b1b0 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:02.332321 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-823bb87f-165a-4bdf-98ce-7e18b3d4b1b0 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:02.498054 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-823bb87f-165a-4bdf-98ce-7e18b3d4b1b0 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:02.504180 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-823bb87f-165a-4bdf-98ce-7e18b3d4b1b0 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1358 microversion: 2.1 time: 0.185215 Aug 02 09:23:02.504746 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 555/1085] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:02 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:03.535645 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-99ea2ca4-ec52-44b8-bcc3-e5c6a5f25da8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:03.536240 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-99ea2ca4-ec52-44b8-bcc3-e5c6a5f25da8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:03.543168 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-99ea2ca4-ec52-44b8-bcc3-e5c6a5f25da8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:03.543608 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-99ea2ca4-ec52-44b8-bcc3-e5c6a5f25da8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:03.544420 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-99ea2ca4-ec52-44b8-bcc3-e5c6a5f25da8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:03.544859 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-99ea2ca4-ec52-44b8-bcc3-e5c6a5f25da8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:03.700757 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-99ea2ca4-ec52-44b8-bcc3-e5c6a5f25da8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:03.709667 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-99ea2ca4-ec52-44b8-bcc3-e5c6a5f25da8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1358 microversion: 2.1 time: 0.178139 Aug 02 09:23:03.710240 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 531/1086] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:03 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:04.732353 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-d9fab9ad-4259-466d-a7c5-1a23472a46bd tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:04.732955 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-d9fab9ad-4259-466d-a7c5-1a23472a46bd tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:04.739266 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d9fab9ad-4259-466d-a7c5-1a23472a46bd tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:04.739718 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d9fab9ad-4259-466d-a7c5-1a23472a46bd tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:04.740559 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d9fab9ad-4259-466d-a7c5-1a23472a46bd tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:04.741278 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-d9fab9ad-4259-466d-a7c5-1a23472a46bd tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:04.885037 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-d9fab9ad-4259-466d-a7c5-1a23472a46bd tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:04.894503 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-d9fab9ad-4259-466d-a7c5-1a23472a46bd tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1358 microversion: 2.1 time: 0.166924 Aug 02 09:23:04.902619 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 556/1087] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:04 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:05.917556 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-3e912357-c96e-467c-abb6-04f871fdb858 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:05.918244 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-3e912357-c96e-467c-abb6-04f871fdb858 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:05.925579 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3e912357-c96e-467c-abb6-04f871fdb858 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:05.926175 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3e912357-c96e-467c-abb6-04f871fdb858 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:05.926820 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3e912357-c96e-467c-abb6-04f871fdb858 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:05.927864 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-3e912357-c96e-467c-abb6-04f871fdb858 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:06.086163 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-3e912357-c96e-467c-abb6-04f871fdb858 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:06.094210 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-3e912357-c96e-467c-abb6-04f871fdb858 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1358 microversion: 2.1 time: 0.182086 Aug 02 09:23:06.094788 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 532/1088] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:05 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:07.119501 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-abc2eb6f-8eb5-4dcd-b0c5-078ccd9b5d47 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:07.120370 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-abc2eb6f-8eb5-4dcd-b0c5-078ccd9b5d47 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:07.127433 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-abc2eb6f-8eb5-4dcd-b0c5-078ccd9b5d47 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:07.127875 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-abc2eb6f-8eb5-4dcd-b0c5-078ccd9b5d47 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:07.128704 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-abc2eb6f-8eb5-4dcd-b0c5-078ccd9b5d47 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:07.129144 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-abc2eb6f-8eb5-4dcd-b0c5-078ccd9b5d47 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:07.278580 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-abc2eb6f-8eb5-4dcd-b0c5-078ccd9b5d47 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:07.300110 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-abc2eb6f-8eb5-4dcd-b0c5-078ccd9b5d47 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1358 microversion: 2.1 time: 0.185703 Aug 02 09:23:07.301209 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 557/1089] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:07 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:08.322977 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-1abf6843-04d4-4c83-9c53-8d1e8d8c0eb9 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:08.323593 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-1abf6843-04d4-4c83-9c53-8d1e8d8c0eb9 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:08.325956 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=2 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:08.330958 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1abf6843-04d4-4c83-9c53-8d1e8d8c0eb9 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:08.331406 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1abf6843-04d4-4c83-9c53-8d1e8d8c0eb9 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:08.332267 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1abf6843-04d4-4c83-9c53-8d1e8d8c0eb9 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:08.332705 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1abf6843-04d4-4c83-9c53-8d1e8d8c0eb9 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:08.476678 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-1abf6843-04d4-4c83-9c53-8d1e8d8c0eb9 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:08.486527 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-1abf6843-04d4-4c83-9c53-8d1e8d8c0eb9 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1358 microversion: 2.1 time: 0.167641 Aug 02 09:23:08.487173 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 533/1090] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:08 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:09.508987 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-26ec972e-f032-4644-80c1-740641593381 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:09.509704 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-26ec972e-f032-4644-80c1-740641593381 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:09.511826 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=6 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:09.517449 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-26ec972e-f032-4644-80c1-740641593381 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:09.517896 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-26ec972e-f032-4644-80c1-740641593381 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:09.518672 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-26ec972e-f032-4644-80c1-740641593381 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:09.519134 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-26ec972e-f032-4644-80c1-740641593381 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:09.638410 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-18bf4926-afcb-4372-b91b-bd539cf84336 req-742198ba-10bd-4630-a676-233926dbfe52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af20a5ab-d853-43c1-9c5e-23b0173f5f61", "tag": "38fb6b81-829b-4822-bd21-faebc95df866"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:23:09.643539 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell0:SELECT=8 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:09.649996 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-18bf4926-afcb-4372-b91b-bd539cf84336 req-742198ba-10bd-4630-a676-233926dbfe52 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:09.650436 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-18bf4926-afcb-4372-b91b-bd539cf84336 req-742198ba-10bd-4630-a676-233926dbfe52 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:09.663790 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-18bf4926-afcb-4372-b91b-bd539cf84336 req-742198ba-10bd-4630-a676-233926dbfe52 service nova] Creating event network-changed:38fb6b81-829b-4822-bd21-faebc95df866 for instance af20a5ab-d853-43c1-9c5e-23b0173f5f61 on hv-cinder-84599 Aug 02 09:23:09.669835 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-18bf4926-afcb-4372-b91b-bd539cf84336 req-742198ba-10bd-4630-a676-233926dbfe52 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035222 Aug 02 09:23:09.670640 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 534/1091] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 02 09:23:09.708659 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-26ec972e-f032-4644-80c1-740641593381 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:09.719949 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-26ec972e-f032-4644-80c1-740641593381 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1358 microversion: 2.1 time: 0.215703 Aug 02 09:23:09.720976 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 558/1092] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:09 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:10.741913 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b9b037d6-b5a3-4612-aa5c-26c281581ae5 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:10.742537 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b9b037d6-b5a3-4612-aa5c-26c281581ae5 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:10.749781 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b9b037d6-b5a3-4612-aa5c-26c281581ae5 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:10.750476 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b9b037d6-b5a3-4612-aa5c-26c281581ae5 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:10.751256 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b9b037d6-b5a3-4612-aa5c-26c281581ae5 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:10.751705 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b9b037d6-b5a3-4612-aa5c-26c281581ae5 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:10.902632 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b9b037d6-b5a3-4612-aa5c-26c281581ae5 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:10.910283 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b9b037d6-b5a3-4612-aa5c-26c281581ae5 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1358 microversion: 2.1 time: 0.172638 Aug 02 09:23:10.910862 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 535/1093] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:10 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:11.933227 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-32cab2f6-a970-4688-bb79-189aeecdabc2 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:11.933849 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-32cab2f6-a970-4688-bb79-189aeecdabc2 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:11.940756 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-32cab2f6-a970-4688-bb79-189aeecdabc2 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:11.941194 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-32cab2f6-a970-4688-bb79-189aeecdabc2 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:11.941967 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-32cab2f6-a970-4688-bb79-189aeecdabc2 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:11.942395 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-32cab2f6-a970-4688-bb79-189aeecdabc2 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:12.084954 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-32cab2f6-a970-4688-bb79-189aeecdabc2 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:12.093589 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-32cab2f6-a970-4688-bb79-189aeecdabc2 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1358 microversion: 2.1 time: 0.165032 Aug 02 09:23:12.094165 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 559/1094] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:11 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:13.113799 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-1357a31c-17c0-4592-9b99-31bf2f23824d tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:13.114433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-1357a31c-17c0-4592-9b99-31bf2f23824d tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:13.121699 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1357a31c-17c0-4592-9b99-31bf2f23824d tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:13.122039 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1357a31c-17c0-4592-9b99-31bf2f23824d tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:13.122804 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1357a31c-17c0-4592-9b99-31bf2f23824d tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:13.123236 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1357a31c-17c0-4592-9b99-31bf2f23824d tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:13.530089 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-1357a31c-17c0-4592-9b99-31bf2f23824d tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:13.537648 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-1357a31c-17c0-4592-9b99-31bf2f23824d tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1358 microversion: 2.1 time: 0.427760 Aug 02 09:23:13.538207 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 536/1095] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:13 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1358 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:14.559929 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-955239e5-656b-4052-b90e-6122b746cea1 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:14.560631 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-955239e5-656b-4052-b90e-6122b746cea1 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:14.567454 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-955239e5-656b-4052-b90e-6122b746cea1 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:14.567898 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-955239e5-656b-4052-b90e-6122b746cea1 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:14.568687 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-955239e5-656b-4052-b90e-6122b746cea1 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:14.569122 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-955239e5-656b-4052-b90e-6122b746cea1 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:14.704627 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-955239e5-656b-4052-b90e-6122b746cea1 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:14.712666 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-955239e5-656b-4052-b90e-6122b746cea1 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1358 microversion: 2.1 time: 0.157330 Aug 02 09:23:14.713236 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 560/1096] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:14 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:15.733733 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-922ebc46-7137-4563-9c39-c37873ab2e51 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:15.734358 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-922ebc46-7137-4563-9c39-c37873ab2e51 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:15.741048 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-922ebc46-7137-4563-9c39-c37873ab2e51 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:15.741498 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-922ebc46-7137-4563-9c39-c37873ab2e51 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:15.742280 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-922ebc46-7137-4563-9c39-c37873ab2e51 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:15.742719 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-922ebc46-7137-4563-9c39-c37873ab2e51 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:15.880795 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-922ebc46-7137-4563-9c39-c37873ab2e51 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:15.889090 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-922ebc46-7137-4563-9c39-c37873ab2e51 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1358 microversion: 2.1 time: 0.159148 Aug 02 09:23:15.889595 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 537/1097] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:15 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:16.073481 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-658505b7-0900-4e15-98a1-fd82fa16407b req-5f999cab-90dc-4b80-8c9d-08acdb0bfc10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af20a5ab-d853-43c1-9c5e-23b0173f5f61", "name": "network-vif-plugged", "status": "completed", "tag": "38fb6b81-829b-4822-bd21-faebc95df866"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:23:16.083019 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-658505b7-0900-4e15-98a1-fd82fa16407b req-5f999cab-90dc-4b80-8c9d-08acdb0bfc10 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:16.083537 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-658505b7-0900-4e15-98a1-fd82fa16407b req-5f999cab-90dc-4b80-8c9d-08acdb0bfc10 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:16.095180 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-658505b7-0900-4e15-98a1-fd82fa16407b req-5f999cab-90dc-4b80-8c9d-08acdb0bfc10 service nova] Creating event network-vif-plugged:38fb6b81-829b-4822-bd21-faebc95df866 for instance af20a5ab-d853-43c1-9c5e-23b0173f5f61 on hv-cinder-84599 Aug 02 09:23:16.100457 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-658505b7-0900-4e15-98a1-fd82fa16407b req-5f999cab-90dc-4b80-8c9d-08acdb0bfc10 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.156538 Aug 02 09:23:16.101051 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 561/1098] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:23:16.910264 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b509a286-dace-4bd2-bb1f-625bf03bf5ef tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:16.910979 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b509a286-dace-4bd2-bb1f-625bf03bf5ef tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:16.919290 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b509a286-dace-4bd2-bb1f-625bf03bf5ef tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:16.919733 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b509a286-dace-4bd2-bb1f-625bf03bf5ef tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:16.920548 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b509a286-dace-4bd2-bb1f-625bf03bf5ef tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:16.920988 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b509a286-dace-4bd2-bb1f-625bf03bf5ef tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:17.063045 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b509a286-dace-4bd2-bb1f-625bf03bf5ef tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:17.070874 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b509a286-dace-4bd2-bb1f-625bf03bf5ef tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1358 microversion: 2.1 time: 0.164457 Aug 02 09:23:17.072425 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 538/1099] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:16 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:18.098947 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-8e15c22b-97bd-4c80-b7c9-cfd859165921 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:18.099710 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-8e15c22b-97bd-4c80-b7c9-cfd859165921 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:18.107131 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8e15c22b-97bd-4c80-b7c9-cfd859165921 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:18.107591 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8e15c22b-97bd-4c80-b7c9-cfd859165921 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:18.108434 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8e15c22b-97bd-4c80-b7c9-cfd859165921 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:18.108876 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-8e15c22b-97bd-4c80-b7c9-cfd859165921 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:18.245126 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-8e15c22b-97bd-4c80-b7c9-cfd859165921 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:18.253196 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-8e15c22b-97bd-4c80-b7c9-cfd859165921 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1548 microversion: 2.1 time: 0.159119 Aug 02 09:23:18.253794 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 562/1100] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:18 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:18.273836 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-554f0210-fc3a-4dee-932f-7f6bfea52098 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:18.274558 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-554f0210-fc3a-4dee-932f-7f6bfea52098 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:18.281338 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-554f0210-fc3a-4dee-932f-7f6bfea52098 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:18.281794 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-554f0210-fc3a-4dee-932f-7f6bfea52098 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:18.282576 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-554f0210-fc3a-4dee-932f-7f6bfea52098 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:18.283010 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-554f0210-fc3a-4dee-932f-7f6bfea52098 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:18.420220 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-554f0210-fc3a-4dee-932f-7f6bfea52098 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:18.427628 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-554f0210-fc3a-4dee-932f-7f6bfea52098 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1548 microversion: 2.1 time: 0.157839 Aug 02 09:23:18.428201 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 539/1101] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:18 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:23:18.447701 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-72c0b3b1-2368-436e-a8f8-4a3a8b517d4f tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:18.452383 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-72c0b3b1-2368-436e-a8f8-4a3a8b517d4f tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:18.453176 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-72c0b3b1-2368-436e-a8f8-4a3a8b517d4f tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Searching by: {'deleted': False, 'project_id': 'ed8821168eca41338809f59eda063b63'} {{(pid=118525) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 02 09:23:18.460480 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-72c0b3b1-2368-436e-a8f8-4a3a8b517d4f tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:18.460929 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-72c0b3b1-2368-436e-a8f8-4a3a8b517d4f tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:18.461755 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-72c0b3b1-2368-436e-a8f8-4a3a8b517d4f tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:18.462720 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-72c0b3b1-2368-436e-a8f8-4a3a8b517d4f tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:18.553735 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.multi_cell_list [None req-72c0b3b1-2368-436e-a8f8-4a3a8b517d4f tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118525) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 02 09:23:18.652522 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-72c0b3b1-2368-436e-a8f8-4a3a8b517d4f tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.208647 Aug 02 09:23:18.653106 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 563/1102] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Aug 2 09:23:18 2022] GET /compute/v2.1/servers => generated 343 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:23:18.664634 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-d15717cd-dfa2-42f0-83b2-99d99f25b9b8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:18.665926 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-d15717cd-dfa2-42f0-83b2-99d99f25b9b8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:18.671983 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d15717cd-dfa2-42f0-83b2-99d99f25b9b8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:18.672456 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d15717cd-dfa2-42f0-83b2-99d99f25b9b8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:18.673222 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d15717cd-dfa2-42f0-83b2-99d99f25b9b8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:18.673649 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-d15717cd-dfa2-42f0-83b2-99d99f25b9b8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:18.810156 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-d15717cd-dfa2-42f0-83b2-99d99f25b9b8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:18.818957 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-d15717cd-dfa2-42f0-83b2-99d99f25b9b8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1548 microversion: 2.1 time: 0.158070 Aug 02 09:23:18.819587 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 540/1103] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:18 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:20.828429 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-934fe956-78bb-44cc-b39f-7a1b52a9aebc tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c9acdb5-de1f-465f-84c8-b8d9c5c52a35"}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:23:20.830765 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-934fe956-78bb-44cc-b39f-7a1b52a9aebc tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:20.837502 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-934fe956-78bb-44cc-b39f-7a1b52a9aebc tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:20.839914 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-934fe956-78bb-44cc-b39f-7a1b52a9aebc tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:20.839914 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-934fe956-78bb-44cc-b39f-7a1b52a9aebc tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:20.839914 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-934fe956-78bb-44cc-b39f-7a1b52a9aebc tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:21.726400 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-934fe956-78bb-44cc-b39f-7a1b52a9aebc tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "POST /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.901723 Aug 02 09:23:21.727083 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 564/1104] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 2 09:23:20 2022] POST /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61/os-volume_attachments => generated 194 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:23:29.316082 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-9bd4c1e8-cbeb-4c0d-b91c-fe8912befcb4 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:29.316740 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-9bd4c1e8-cbeb-4c0d-b91c-fe8912befcb4 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:29.319415 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:29.320245 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=64 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:29.325145 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9bd4c1e8-cbeb-4c0d-b91c-fe8912befcb4 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:29.325600 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9bd4c1e8-cbeb-4c0d-b91c-fe8912befcb4 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:29.326388 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9bd4c1e8-cbeb-4c0d-b91c-fe8912befcb4 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:29.326859 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9bd4c1e8-cbeb-4c0d-b91c-fe8912befcb4 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:29.459203 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-9bd4c1e8-cbeb-4c0d-b91c-fe8912befcb4 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:29.468824 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-9bd4c1e8-cbeb-4c0d-b91c-fe8912befcb4 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1594 microversion: 2.1 time: 0.156508 Aug 02 09:23:29.469405 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 541/1105] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:29 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1594 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:31.466572 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-f2e48ca6-539d-492c-aa7b-2623233add95 req-a3239c98-db4e-46f3-97d6-95a90e5d5ac5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af20a5ab-d853-43c1-9c5e-23b0173f5f61", "tag": "38fb6b81-829b-4822-bd21-faebc95df866"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:23:31.473070 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell0:SELECT=2 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:31.474151 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:31.481633 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-f2e48ca6-539d-492c-aa7b-2623233add95 req-a3239c98-db4e-46f3-97d6-95a90e5d5ac5 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:31.482990 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-f2e48ca6-539d-492c-aa7b-2623233add95 req-a3239c98-db4e-46f3-97d6-95a90e5d5ac5 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:31.487200 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:31.494106 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-f2e48ca6-539d-492c-aa7b-2623233add95 req-a3239c98-db4e-46f3-97d6-95a90e5d5ac5 service nova] Creating event network-changed:38fb6b81-829b-4822-bd21-faebc95df866 for instance af20a5ab-d853-43c1-9c5e-23b0173f5f61 on hv-cinder-84599 Aug 02 09:23:31.500672 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-f2e48ca6-539d-492c-aa7b-2623233add95 req-a3239c98-db4e-46f3-97d6-95a90e5d5ac5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040130 Aug 02 09:23:31.501284 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 565/1106] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:23:33.664415 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-6b18149c-de92-447f-b3e0-13378b08464c tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1466926154"}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:23:33.664972 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-6b18149c-de92-447f-b3e0-13378b08464c tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:33.672710 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6b18149c-de92-447f-b3e0-13378b08464c tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:33.673205 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6b18149c-de92-447f-b3e0-13378b08464c tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:33.674103 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6b18149c-de92-447f-b3e0-13378b08464c tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:33.674603 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-6b18149c-de92-447f-b3e0-13378b08464c tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:33.803108 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.network.security_group_api [None req-6b18149c-de92-447f-b3e0-13378b08464c tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Adding security group 14d97496-d271-470b-8ae7-8ad5cacf8da8 to port 38fb6b81-829b-4822-bd21-faebc95df866 Aug 02 09:23:34.188263 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-6b18149c-de92-447f-b3e0-13378b08464c tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "POST /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61/action" status: 202 len: 0 microversion: 2.1 time: 0.527750 Aug 02 09:23:34.188865 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 542/1107] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 2 09:23:33 2022] POST /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61/action => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:23:34.197223 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-770e5271-5a2b-474d-8c0c-fde1bb53b8f9 req-1e79c402-69d5-492a-bda8-e79c994f3377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af20a5ab-d853-43c1-9c5e-23b0173f5f61", "tag": "38fb6b81-829b-4822-bd21-faebc95df866"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:23:34.198650 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-2e6a3519-7c3c-4392-9955-3c9ea7272c37 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:34.199431 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-2e6a3519-7c3c-4392-9955-3c9ea7272c37 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:34.209797 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-770e5271-5a2b-474d-8c0c-fde1bb53b8f9 req-1e79c402-69d5-492a-bda8-e79c994f3377 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:34.210245 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-770e5271-5a2b-474d-8c0c-fde1bb53b8f9 req-1e79c402-69d5-492a-bda8-e79c994f3377 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:34.212902 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2e6a3519-7c3c-4392-9955-3c9ea7272c37 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:34.213561 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2e6a3519-7c3c-4392-9955-3c9ea7272c37 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:34.214426 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2e6a3519-7c3c-4392-9955-3c9ea7272c37 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:34.215082 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2e6a3519-7c3c-4392-9955-3c9ea7272c37 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:34.223460 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-770e5271-5a2b-474d-8c0c-fde1bb53b8f9 req-1e79c402-69d5-492a-bda8-e79c994f3377 service nova] Creating event network-changed:38fb6b81-829b-4822-bd21-faebc95df866 for instance af20a5ab-d853-43c1-9c5e-23b0173f5f61 on hv-cinder-84599 Aug 02 09:23:34.229027 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-770e5271-5a2b-474d-8c0c-fde1bb53b8f9 req-1e79c402-69d5-492a-bda8-e79c994f3377 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035377 Aug 02 09:23:34.230122 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 543/1108] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:23:34.481378 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-2e6a3519-7c3c-4392-9955-3c9ea7272c37 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:34.490993 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-2e6a3519-7c3c-4392-9955-3c9ea7272c37 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1760 microversion: 2.1 time: 0.297145 Aug 02 09:23:34.491893 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 566/1109] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:34 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1760 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:51.259117 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=6 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:51.259965 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=12 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:51.264153 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-9311d8d5-7362-4311-9222-edeffa0c050a tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:23:51.266433 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-9311d8d5-7362-4311-9222-edeffa0c050a tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:51.273370 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9311d8d5-7362-4311-9222-edeffa0c050a tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:51.276504 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9311d8d5-7362-4311-9222-edeffa0c050a tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:51.276504 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9311d8d5-7362-4311-9222-edeffa0c050a tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:51.276504 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9311d8d5-7362-4311-9222-edeffa0c050a tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:51.556589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-9311d8d5-7362-4311-9222-edeffa0c050a tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "POST /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61/action" status: 202 len: 0 microversion: 2.1 time: 0.298494 Aug 02 09:23:51.557267 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 544/1110] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 2 09:23:51 2022] POST /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:23:51.568870 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-fa359655-0418-4549-a440-e8c5aae9f20b tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:51.569581 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-fa359655-0418-4549-a440-e8c5aae9f20b tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:51.578008 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=4 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:51.578905 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=7 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:23:51.590757 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fa359655-0418-4549-a440-e8c5aae9f20b tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:51.597350 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fa359655-0418-4549-a440-e8c5aae9f20b tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:51.597350 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fa359655-0418-4549-a440-e8c5aae9f20b tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:51.597350 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fa359655-0418-4549-a440-e8c5aae9f20b tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:51.821683 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-fa359655-0418-4549-a440-e8c5aae9f20b tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:51.831259 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-fa359655-0418-4549-a440-e8c5aae9f20b tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1752 microversion: 2.1 time: 0.268319 Aug 02 09:23:51.831858 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 567/1111] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:51 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1752 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:52.859760 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-e853997e-dcfe-46f0-a480-8e6206743eab tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:52.861117 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-e853997e-dcfe-46f0-a480-8e6206743eab tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:52.867451 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e853997e-dcfe-46f0-a480-8e6206743eab tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:52.867903 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e853997e-dcfe-46f0-a480-8e6206743eab tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:52.875157 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e853997e-dcfe-46f0-a480-8e6206743eab tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:52.875157 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-e853997e-dcfe-46f0-a480-8e6206743eab tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:53.026407 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-e853997e-dcfe-46f0-a480-8e6206743eab tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:53.034940 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-e853997e-dcfe-46f0-a480-8e6206743eab tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1757 microversion: 2.1 time: 0.180051 Aug 02 09:23:53.035496 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 545/1112] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:52 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:54.056626 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-2604c549-ddbd-4e3f-8920-04905de45596 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:54.057352 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-2604c549-ddbd-4e3f-8920-04905de45596 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:54.065328 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2604c549-ddbd-4e3f-8920-04905de45596 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:54.065769 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2604c549-ddbd-4e3f-8920-04905de45596 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:54.066538 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2604c549-ddbd-4e3f-8920-04905de45596 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:54.066964 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-2604c549-ddbd-4e3f-8920-04905de45596 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:54.211942 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-2604c549-ddbd-4e3f-8920-04905de45596 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:54.220796 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-2604c549-ddbd-4e3f-8920-04905de45596 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1757 microversion: 2.1 time: 0.168319 Aug 02 09:23:54.221355 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 568/1113] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:54 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:55.242749 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-9ce81ca5-b79d-4013-9024-74bf3eb630cf tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:55.243446 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-9ce81ca5-b79d-4013-9024-74bf3eb630cf tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:55.250027 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9ce81ca5-b79d-4013-9024-74bf3eb630cf tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:55.250499 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9ce81ca5-b79d-4013-9024-74bf3eb630cf tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:55.251887 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9ce81ca5-b79d-4013-9024-74bf3eb630cf tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:55.253349 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9ce81ca5-b79d-4013-9024-74bf3eb630cf tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:55.400622 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-9ce81ca5-b79d-4013-9024-74bf3eb630cf tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:55.410098 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-9ce81ca5-b79d-4013-9024-74bf3eb630cf tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1757 microversion: 2.1 time: 0.171274 Aug 02 09:23:55.410685 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 546/1114] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:55 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:56.431027 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-03c8e2b3-f04c-4ef6-b13b-28b3a7f2cb27 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:56.435932 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-03c8e2b3-f04c-4ef6-b13b-28b3a7f2cb27 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:56.438959 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-03c8e2b3-f04c-4ef6-b13b-28b3a7f2cb27 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:56.439556 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-03c8e2b3-f04c-4ef6-b13b-28b3a7f2cb27 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:56.440363 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-03c8e2b3-f04c-4ef6-b13b-28b3a7f2cb27 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:56.440829 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-03c8e2b3-f04c-4ef6-b13b-28b3a7f2cb27 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:56.600888 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-03c8e2b3-f04c-4ef6-b13b-28b3a7f2cb27 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:56.609140 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-03c8e2b3-f04c-4ef6-b13b-28b3a7f2cb27 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1757 microversion: 2.1 time: 0.181982 Aug 02 09:23:56.609711 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 569/1115] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:56 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:57.631584 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-37cd023d-5b4d-41b4-86b6-7cb4f98ce965 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:57.632253 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-37cd023d-5b4d-41b4-86b6-7cb4f98ce965 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:57.638882 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-37cd023d-5b4d-41b4-86b6-7cb4f98ce965 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:57.639327 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-37cd023d-5b4d-41b4-86b6-7cb4f98ce965 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:57.640193 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-37cd023d-5b4d-41b4-86b6-7cb4f98ce965 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:57.640640 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-37cd023d-5b4d-41b4-86b6-7cb4f98ce965 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:57.791891 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-37cd023d-5b4d-41b4-86b6-7cb4f98ce965 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:57.801017 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-37cd023d-5b4d-41b4-86b6-7cb4f98ce965 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1757 microversion: 2.1 time: 0.173377 Aug 02 09:23:57.801589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 547/1116] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:57 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1757 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:23:58.827808 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-1fa78532-1aea-467f-b8ef-c02bb163f077 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:23:58.828544 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-1fa78532-1aea-467f-b8ef-c02bb163f077 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:23:58.835526 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1fa78532-1aea-467f-b8ef-c02bb163f077 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:58.835964 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1fa78532-1aea-467f-b8ef-c02bb163f077 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:58.836757 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1fa78532-1aea-467f-b8ef-c02bb163f077 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:23:58.837187 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-1fa78532-1aea-467f-b8ef-c02bb163f077 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:23:58.988724 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-1fa78532-1aea-467f-b8ef-c02bb163f077 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:23:58.997015 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-1fa78532-1aea-467f-b8ef-c02bb163f077 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1757 microversion: 2.1 time: 0.173174 Aug 02 09:23:58.997617 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 570/1117] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:23:58 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:24:00.019279 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-ea154519-ea5e-4586-9f57-d75394b8819e tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:24:00.019892 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-ea154519-ea5e-4586-9f57-d75394b8819e tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:24:00.026463 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ea154519-ea5e-4586-9f57-d75394b8819e tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:00.026943 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ea154519-ea5e-4586-9f57-d75394b8819e tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:00.027720 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ea154519-ea5e-4586-9f57-d75394b8819e tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:00.028175 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-ea154519-ea5e-4586-9f57-d75394b8819e tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:00.176560 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-ea154519-ea5e-4586-9f57-d75394b8819e tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:24:00.184620 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-ea154519-ea5e-4586-9f57-d75394b8819e tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1757 microversion: 2.1 time: 0.169796 Aug 02 09:24:00.185191 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 548/1118] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:24:00 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:24:01.206833 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-fcb566b2-c5ba-46d7-bf5f-ec09ae154fe9 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:24:01.207469 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-fcb566b2-c5ba-46d7-bf5f-ec09ae154fe9 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:24:01.214216 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fcb566b2-c5ba-46d7-bf5f-ec09ae154fe9 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:01.214658 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fcb566b2-c5ba-46d7-bf5f-ec09ae154fe9 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:01.215423 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fcb566b2-c5ba-46d7-bf5f-ec09ae154fe9 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:01.215856 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-fcb566b2-c5ba-46d7-bf5f-ec09ae154fe9 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:01.365516 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-fcb566b2-c5ba-46d7-bf5f-ec09ae154fe9 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:24:01.373563 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-fcb566b2-c5ba-46d7-bf5f-ec09ae154fe9 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1757 microversion: 2.1 time: 0.171203 Aug 02 09:24:01.374130 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 571/1119] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:24:01 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:24:02.395673 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-9aaa081e-4b0b-4377-b34f-8251adea48c8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:24:02.396330 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-9aaa081e-4b0b-4377-b34f-8251adea48c8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:24:02.402961 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9aaa081e-4b0b-4377-b34f-8251adea48c8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:02.403412 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9aaa081e-4b0b-4377-b34f-8251adea48c8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:02.404204 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9aaa081e-4b0b-4377-b34f-8251adea48c8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:02.404655 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-9aaa081e-4b0b-4377-b34f-8251adea48c8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:02.554640 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-9aaa081e-4b0b-4377-b34f-8251adea48c8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:24:02.563080 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-9aaa081e-4b0b-4377-b34f-8251adea48c8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1757 microversion: 2.1 time: 0.171415 Aug 02 09:24:02.564498 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 549/1120] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:24:02 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:24:03.591122 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-06ac04ac-3837-4876-a944-66aab3fabf48 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:24:03.591730 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-06ac04ac-3837-4876-a944-66aab3fabf48 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:24:03.599288 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-06ac04ac-3837-4876-a944-66aab3fabf48 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:03.599734 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-06ac04ac-3837-4876-a944-66aab3fabf48 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:03.600648 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-06ac04ac-3837-4876-a944-66aab3fabf48 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:03.600984 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-06ac04ac-3837-4876-a944-66aab3fabf48 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:03.746758 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-06ac04ac-3837-4876-a944-66aab3fabf48 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:24:03.754798 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-06ac04ac-3837-4876-a944-66aab3fabf48 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1757 microversion: 2.1 time: 0.167658 Aug 02 09:24:03.755363 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 572/1121] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:24:03 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:24:04.776532 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-1c8d3306-97a2-4274-a4f8-da5ce6b83c8e tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:24:04.777138 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-1c8d3306-97a2-4274-a4f8-da5ce6b83c8e tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:24:04.784180 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1c8d3306-97a2-4274-a4f8-da5ce6b83c8e tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:04.784675 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1c8d3306-97a2-4274-a4f8-da5ce6b83c8e tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:04.785541 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1c8d3306-97a2-4274-a4f8-da5ce6b83c8e tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:04.785989 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-1c8d3306-97a2-4274-a4f8-da5ce6b83c8e tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:04.935615 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-1c8d3306-97a2-4274-a4f8-da5ce6b83c8e tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:24:04.945365 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-1c8d3306-97a2-4274-a4f8-da5ce6b83c8e tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1757 microversion: 2.1 time: 0.172707 Aug 02 09:24:04.945937 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 550/1122] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:24:04 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:24:05.967172 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-cfd70cdf-f951-4a64-9cb0-bfdd23cad6b8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:24:05.967793 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-cfd70cdf-f951-4a64-9cb0-bfdd23cad6b8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:24:05.974392 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cfd70cdf-f951-4a64-9cb0-bfdd23cad6b8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:05.974868 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cfd70cdf-f951-4a64-9cb0-bfdd23cad6b8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:05.975637 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cfd70cdf-f951-4a64-9cb0-bfdd23cad6b8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:05.976073 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-cfd70cdf-f951-4a64-9cb0-bfdd23cad6b8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:06.121309 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-cfd70cdf-f951-4a64-9cb0-bfdd23cad6b8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:24:06.130060 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-cfd70cdf-f951-4a64-9cb0-bfdd23cad6b8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1757 microversion: 2.1 time: 0.166734 Aug 02 09:24:06.130631 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 573/1123] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:24:05 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:24:07.152669 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-106f27e6-c9bf-4056-9ab4-1e6d2404a343 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:24:07.153260 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-106f27e6-c9bf-4056-9ab4-1e6d2404a343 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:24:07.160452 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-106f27e6-c9bf-4056-9ab4-1e6d2404a343 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:07.160907 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-106f27e6-c9bf-4056-9ab4-1e6d2404a343 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:07.161679 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-106f27e6-c9bf-4056-9ab4-1e6d2404a343 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:07.162118 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-106f27e6-c9bf-4056-9ab4-1e6d2404a343 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:07.313609 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-106f27e6-c9bf-4056-9ab4-1e6d2404a343 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:24:07.321714 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-106f27e6-c9bf-4056-9ab4-1e6d2404a343 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1757 microversion: 2.1 time: 0.172952 Aug 02 09:24:07.322282 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 551/1124] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:24:07 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:24:08.343469 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-3b65dbe9-cc96-44e4-bfa4-7766a89b128a tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:24:08.344096 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-3b65dbe9-cc96-44e4-bfa4-7766a89b128a tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:24:08.351743 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3b65dbe9-cc96-44e4-bfa4-7766a89b128a tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:08.352223 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3b65dbe9-cc96-44e4-bfa4-7766a89b128a tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:08.352999 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3b65dbe9-cc96-44e4-bfa4-7766a89b128a tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:08.353438 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-3b65dbe9-cc96-44e4-bfa4-7766a89b128a tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:08.499970 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-3b65dbe9-cc96-44e4-bfa4-7766a89b128a tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:24:08.509133 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-3b65dbe9-cc96-44e4-bfa4-7766a89b128a tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1757 microversion: 2.1 time: 0.169415 Aug 02 09:24:08.509716 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 574/1125] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:24:08 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:24:09.053805 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:24:09.054071 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Tue Aug 2 09:24:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:24:09.530527 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b92b55ab-fc43-44e5-a734-a9523cb0e0e7 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:24:09.531137 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b92b55ab-fc43-44e5-a734-a9523cb0e0e7 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:24:09.538421 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b92b55ab-fc43-44e5-a734-a9523cb0e0e7 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:09.538868 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b92b55ab-fc43-44e5-a734-a9523cb0e0e7 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:09.539707 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b92b55ab-fc43-44e5-a734-a9523cb0e0e7 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:09.540186 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b92b55ab-fc43-44e5-a734-a9523cb0e0e7 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:09.697081 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-b92b55ab-fc43-44e5-a734-a9523cb0e0e7 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:24:09.705030 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b92b55ab-fc43-44e5-a734-a9523cb0e0e7 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1760 microversion: 2.1 time: 0.178385 Aug 02 09:24:09.705591 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 552/1126] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:24:09 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1760 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:24:42.080874 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-12c6ff95-b1f1-48e9-a476-5e45500e4d9c tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1466926154"}} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:24:42.081639 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-12c6ff95-b1f1-48e9-a476-5e45500e4d9c tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:24:42.083565 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_api:SELECT=16 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:42.084385 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG dbcounter [-] [118525] Writing DB stats nova_cell1:SELECT=48 {{(pid=118525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:42.089214 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-12c6ff95-b1f1-48e9-a476-5e45500e4d9c tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:42.089663 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-12c6ff95-b1f1-48e9-a476-5e45500e4d9c tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:42.090483 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-12c6ff95-b1f1-48e9-a476-5e45500e4d9c tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:42.090935 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-12c6ff95-b1f1-48e9-a476-5e45500e4d9c tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:42.236536 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.network.security_group_api [None req-12c6ff95-b1f1-48e9-a476-5e45500e4d9c tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Removing security group 14d97496-d271-470b-8ae7-8ad5cacf8da8 from port 38fb6b81-829b-4822-bd21-faebc95df866 Aug 02 09:24:42.621421 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-12c6ff95-b1f1-48e9-a476-5e45500e4d9c tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "POST /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61/action" status: 202 len: 0 microversion: 2.1 time: 0.544477 Aug 02 09:24:42.622056 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 575/1127] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 2 09:24:42 2022] POST /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:24:42.631502 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-2495f214-f4cd-4a8e-993b-4d2eff437f6d req-f4789116-93e4-478d-a1f0-9ba50b76bc83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af20a5ab-d853-43c1-9c5e-23b0173f5f61", "tag": "38fb6b81-829b-4822-bd21-faebc95df866"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:24:42.644090 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_api:SELECT=18 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:42.645511 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG dbcounter [-] [118526] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118526) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 09:24:42.648591 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-2495f214-f4cd-4a8e-993b-4d2eff437f6d req-f4789116-93e4-478d-a1f0-9ba50b76bc83 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:42.651919 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-2495f214-f4cd-4a8e-993b-4d2eff437f6d req-f4789116-93e4-478d-a1f0-9ba50b76bc83 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:42.666918 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-2495f214-f4cd-4a8e-993b-4d2eff437f6d req-f4789116-93e4-478d-a1f0-9ba50b76bc83 service nova] Creating event network-changed:38fb6b81-829b-4822-bd21-faebc95df866 for instance af20a5ab-d853-43c1-9c5e-23b0173f5f61 on hv-cinder-84599 Aug 02 09:24:42.674184 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-2495f214-f4cd-4a8e-993b-4d2eff437f6d req-f4789116-93e4-478d-a1f0-9ba50b76bc83 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048100 Aug 02 09:24:42.676903 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 553/1128] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:24:44.101344 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-5c87e9a7-cc1a-490f-a36e-884c7747b644 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:24:44.102624 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-5c87e9a7-cc1a-490f-a36e-884c7747b644 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:24:44.108578 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5c87e9a7-cc1a-490f-a36e-884c7747b644 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:44.109021 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5c87e9a7-cc1a-490f-a36e-884c7747b644 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:44.109788 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5c87e9a7-cc1a-490f-a36e-884c7747b644 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:44.110215 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-5c87e9a7-cc1a-490f-a36e-884c7747b644 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:44.197737 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.objects.instance [None req-5c87e9a7-cc1a-490f-a36e-884c7747b644 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lazy-loading 'services' on Instance uuid af20a5ab-d853-43c1-9c5e-23b0173f5f61 {{(pid=118525) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 02 09:24:44.472708 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-5c87e9a7-cc1a-490f-a36e-884c7747b644 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "DELETE /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61/os-volume_attachments/8c9acdb5-de1f-465f-84c8-b8d9c5c52a35" status: 202 len: 0 microversion: 2.1 time: 0.375882 Aug 02 09:24:44.473480 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 576/1129] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 2 09:24:44 2022] DELETE /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61/os-volume_attachments/8c9acdb5-de1f-465f-84c8-b8d9c5c52a35 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 02 09:24:44.485541 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-b67f2e03-b35c-46aa-8a86-d1f03acb096b tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:24:44.489901 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-b67f2e03-b35c-46aa-8a86-d1f03acb096b tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:24:44.499098 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b67f2e03-b35c-46aa-8a86-d1f03acb096b tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:44.499613 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b67f2e03-b35c-46aa-8a86-d1f03acb096b tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:44.500424 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b67f2e03-b35c-46aa-8a86-d1f03acb096b tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:44.500867 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-b67f2e03-b35c-46aa-8a86-d1f03acb096b tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:44.533589 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-b67f2e03-b35c-46aa-8a86-d1f03acb096b tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053141 Aug 02 09:24:44.534396 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 554/1130] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:24:44 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:24:44.691273 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [req-7fc565b2-8a86-4d74-aa96-7f34c9d41d1e req-a8ae2586-7eb4-42b6-b1ad-dab81893ad8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af20a5ab-d853-43c1-9c5e-23b0173f5f61", "tag": "38fb6b81-829b-4822-bd21-faebc95df866"}]} {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:24:44.701743 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-7fc565b2-8a86-4d74-aa96-7f34c9d41d1e req-a8ae2586-7eb4-42b6-b1ad-dab81893ad8d service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:44.702197 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [req-7fc565b2-8a86-4d74-aa96-7f34c9d41d1e req-a8ae2586-7eb4-42b6-b1ad-dab81893ad8d service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:44.714773 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.compute.server_external_events [req-7fc565b2-8a86-4d74-aa96-7f34c9d41d1e req-a8ae2586-7eb4-42b6-b1ad-dab81893ad8d service nova] Creating event network-changed:38fb6b81-829b-4822-bd21-faebc95df866 for instance af20a5ab-d853-43c1-9c5e-23b0173f5f61 on hv-cinder-84599 Aug 02 09:24:44.719652 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [req-7fc565b2-8a86-4d74-aa96-7f34c9d41d1e req-a8ae2586-7eb4-42b6-b1ad-dab81893ad8d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032474 Aug 02 09:24:44.720264 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 577/1131] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:24:45.546859 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-68637233-7aa7-4863-871f-d3823521d39e tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:24:45.548976 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-68637233-7aa7-4863-871f-d3823521d39e tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:24:45.557282 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-68637233-7aa7-4863-871f-d3823521d39e tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:45.560374 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-68637233-7aa7-4863-871f-d3823521d39e tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:45.560374 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-68637233-7aa7-4863-871f-d3823521d39e tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:45.560374 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-68637233-7aa7-4863-871f-d3823521d39e tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:45.589011 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-68637233-7aa7-4863-871f-d3823521d39e tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046217 Aug 02 09:24:45.589750 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 555/1132] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:24:45 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:24:46.603552 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-ce0cccb2-8f0d-4bf5-a443-819e3a4b02ef tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:24:46.605854 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-ce0cccb2-8f0d-4bf5-a443-819e3a4b02ef tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:24:46.612124 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ce0cccb2-8f0d-4bf5-a443-819e3a4b02ef tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:46.612599 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ce0cccb2-8f0d-4bf5-a443-819e3a4b02ef tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:46.613392 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ce0cccb2-8f0d-4bf5-a443-819e3a4b02ef tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:46.613817 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-ce0cccb2-8f0d-4bf5-a443-819e3a4b02ef tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:46.644978 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-ce0cccb2-8f0d-4bf5-a443-819e3a4b02ef tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046688 Aug 02 09:24:46.645540 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 578/1133] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 2 09:24:46 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 02 09:24:46.656503 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-8435114d-4e11-4de3-a00e-8aa972f32ad8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:24:46.657097 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-8435114d-4e11-4de3-a00e-8aa972f32ad8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:24:46.672198 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-8435114d-4e11-4de3-a00e-8aa972f32ad8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:46.672659 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-8435114d-4e11-4de3-a00e-8aa972f32ad8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:46.673449 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-8435114d-4e11-4de3-a00e-8aa972f32ad8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:46.673892 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-8435114d-4e11-4de3-a00e-8aa972f32ad8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:46.750953 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-8435114d-4e11-4de3-a00e-8aa972f32ad8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] HTTP exception thrown: Instance af20a5ab-d853-43c1-9c5e-23b0173f5f61 is not attached to volume 8c9acdb5-de1f-465f-84c8-b8d9c5c52a35 Aug 02 09:24:46.753391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-8435114d-4e11-4de3-a00e-8aa972f32ad8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Request method failure captured: Aug 02 09:24:46.753391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: DELETE /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61/os-volume_attachments/8c9acdb5-de1f-465f-84c8-b8d9c5c52a35 HTTP/1.1 Aug 02 09:24:46.753391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:24:46.753391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:24:46.753391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:24:46.753391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:24:46.753391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:24:46.753391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:24:46.753391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:24:46.753391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:24:46.753391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OzdnAz44NHhYiVYnm08_RmhexPnCapKo8XN64qeOq79o8tBZXHDkI9-Fsfi5BMdkpwvEMw3Q6QdI6uc6qO9Zugxk2HqmzYZ5r_Hl-OuPdqwzSR_8qQrlCXgnKahrOZ9SYhpvzKF_iFFQdZG2_2ieKk0SDiHPGRw2RkbnU-_YVSpzVM Aug 02 09:24:46.753391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:24:46.753391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:24:46.753391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:24:46.753391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:24:46.753391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:24:46.753391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:24:46.753391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: ed8821168eca41338809f59eda063b63 Aug 02 09:24:46.753391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-TestMinimumBasicScenario-1747183566 Aug 02 09:24:46.753391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:24:46.753391 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:24:46.755163 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed8821168eca41338809f59eda063b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ed8821168eca41338809f59eda063b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed8821168eca41338809f59eda063b63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ed8821168eca41338809f59eda063b63"}]}] Aug 02 09:24:46.755163 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-TestMinimumBasicScenario-1747183566 Aug 02 09:24:46.755163 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: ed8821168eca41338809f59eda063b63 Aug 02 09:24:46.755163 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1747183566 Aug 02 09:24:46.755163 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-TestMinimumBasicScenario-1747183566-project Aug 02 09:24:46.755163 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:24:46.755163 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:24:46.755163 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: 88bb10103dc8467793345f8fb164ecbb Aug 02 09:24:46.755163 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-TestMinimumBasicScenario-1747183566-project Aug 02 09:24:46.755163 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:24:46.755163 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Instance af20a5ab-d853-43c1-9c5e-23b0173f5f61 is not attached to volume 8c9acdb5-de1f-465f-84c8-b8d9c5c52a35 Aug 02 09:24:46.756334 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'server_id': 'af20a5ab-d853-43c1-9c5e-23b0173f5f61', 'id': '8c9acdb5-de1f-465f-84c8-b8d9c5c52a35'} Aug 02 09:24:46.756334 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:24:46.756334 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:24:46.756334 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 02 09:24:46.756334 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 02 09:24:46.756334 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 02 09:24:46.756334 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 02 09:24:46.756334 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 02 09:24:46.756334 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 02 09:24:46.756334 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8c9acdb5-de1f-465f-84c8-b8d9c5c52a35. Aug 02 09:24:46.756334 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:24:46.756334 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:24:46.756334 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:24:46.756334 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:24:46.756334 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:24:46.756334 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:24:46.756334 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:24:46.756334 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:24:46.756334 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:24:46.758814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:24:46.758814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 02 09:24:46.758814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 02 09:24:46.758814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af20a5ab-d853-43c1-9c5e-23b0173f5f61 is not attached to volume 8c9acdb5-de1f-465f-84c8-b8d9c5c52a35 Aug 02 09:24:46.758814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:24:46.758814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:24:46.758814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:24:46.758814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:24:46.758814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:24:46.758814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:24:46.758814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:24:46.758814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:24:46.758814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af20a5ab-d853-43c1-9c5e-23b0173f5f61 is not attached to volume 8c9acdb5-de1f-465f-84c8-b8d9c5c52a35 Aug 02 09:24:46.758814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:24:46.758814 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-8435114d-4e11-4de3-a00e-8aa972f32ad8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Returning 404 to user: Instance af20a5ab-d853-43c1-9c5e-23b0173f5f61 is not attached to volume 8c9acdb5-de1f-465f-84c8-b8d9c5c52a35 {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:24:46.760100 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-8435114d-4e11-4de3-a00e-8aa972f32ad8 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "DELETE /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61/os-volume_attachments/8c9acdb5-de1f-465f-84c8-b8d9c5c52a35" status: 404 len: 154 microversion: 2.1 time: 0.102741 Aug 02 09:24:46.760100 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 556/1134] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 2 09:24:46 2022] DELETE /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61/os-volume_attachments/8c9acdb5-de1f-465f-84c8-b8d9c5c52a35 => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:24:48.025922 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-c46e8ca1-dab2-4490-ac43-dc9a4f00fc04 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:24:48.026487 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-c46e8ca1-dab2-4490-ac43-dc9a4f00fc04 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:24:48.033873 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c46e8ca1-dab2-4490-ac43-dc9a4f00fc04 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:48.034322 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c46e8ca1-dab2-4490-ac43-dc9a4f00fc04 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:48.035754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c46e8ca1-dab2-4490-ac43-dc9a4f00fc04 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:48.035754 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-c46e8ca1-dab2-4490-ac43-dc9a4f00fc04 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:48.062289 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-c46e8ca1-dab2-4490-ac43-dc9a4f00fc04 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Going to try to terminate instance {{(pid=118525) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 02 09:24:48.378511 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-c46e8ca1-dab2-4490-ac43-dc9a4f00fc04 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "DELETE /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 204 len: 0 microversion: 2.1 time: 0.357297 Aug 02 09:24:48.379031 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 579/1135] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 2 09:24:48 2022] DELETE /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 02 09:24:48.387635 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-850c59fa-9cad-4c1c-b6e0-91af31673fcf tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:24:48.388518 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-850c59fa-9cad-4c1c-b6e0-91af31673fcf tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:24:48.394625 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-850c59fa-9cad-4c1c-b6e0-91af31673fcf tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:48.395240 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-850c59fa-9cad-4c1c-b6e0-91af31673fcf tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:48.395830 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-850c59fa-9cad-4c1c-b6e0-91af31673fcf tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:48.396297 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-850c59fa-9cad-4c1c-b6e0-91af31673fcf tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:48.531137 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.policy [None req-850c59fa-9cad-4c1c-b6e0-91af31673fcf tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118526) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:24:48.539434 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-850c59fa-9cad-4c1c-b6e0-91af31673fcf tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1554 microversion: 2.1 time: 0.155893 Aug 02 09:24:48.540005 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 557/1136] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:24:48 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:24:49.562441 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-bf88134c-5947-46f5-9a65-4aa54e3892bd tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:24:49.563262 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-bf88134c-5947-46f5-9a65-4aa54e3892bd tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:24:49.570511 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bf88134c-5947-46f5-9a65-4aa54e3892bd tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:49.570958 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bf88134c-5947-46f5-9a65-4aa54e3892bd tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:49.571737 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bf88134c-5947-46f5-9a65-4aa54e3892bd tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:49.572187 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-bf88134c-5947-46f5-9a65-4aa54e3892bd tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:49.710314 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-bf88134c-5947-46f5-9a65-4aa54e3892bd tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:24:49.717889 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-bf88134c-5947-46f5-9a65-4aa54e3892bd tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1554 microversion: 2.1 time: 0.160208 Aug 02 09:24:49.718456 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 580/1137] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:24:49 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 02 09:24:50.703442 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [req-81255bc5-2c3e-4840-a40b-dcba1b9069e3 req-fcb83527-1760-48d1-94d0-855279cbd758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af20a5ab-d853-43c1-9c5e-23b0173f5f61", "name": "network-vif-deleted", "tag": "38fb6b81-829b-4822-bd21-faebc95df866"}]} {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 02 09:24:50.715160 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-81255bc5-2c3e-4840-a40b-dcba1b9069e3 req-fcb83527-1760-48d1-94d0-855279cbd758 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:50.715728 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [req-81255bc5-2c3e-4840-a40b-dcba1b9069e3 req-fcb83527-1760-48d1-94d0-855279cbd758 service nova] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:50.726972 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.compute.server_external_events [req-81255bc5-2c3e-4840-a40b-dcba1b9069e3 req-fcb83527-1760-48d1-94d0-855279cbd758 service nova] Creating event network-vif-deleted:38fb6b81-829b-4822-bd21-faebc95df866 for instance af20a5ab-d853-43c1-9c5e-23b0173f5f61 on hv-cinder-84599 Aug 02 09:24:50.732698 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [req-81255bc5-2c3e-4840-a40b-dcba1b9069e3 req-fcb83527-1760-48d1-94d0-855279cbd758 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033007 Aug 02 09:24:50.734035 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 558/1138] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 2 09:24:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 02 09:24:50.738922 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-da5ce2d9-7822-4668-9606-3a0490533145 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:24:50.739540 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.compute.api [None req-da5ce2d9-7822-4668-9606-3a0490533145 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118525) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:24:50.746987 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-da5ce2d9-7822-4668-9606-3a0490533145 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:50.747435 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-da5ce2d9-7822-4668-9606-3a0490533145 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:50.748248 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-da5ce2d9-7822-4668-9606-3a0490533145 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:50.748695 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG oslo_concurrency.lockutils [None req-da5ce2d9-7822-4668-9606-3a0490533145 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118525) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:50.816254 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.policy [None req-da5ce2d9-7822-4668-9606-3a0490533145 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88bb10103dc8467793345f8fb164ecbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed8821168eca41338809f59eda063b63', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118525) authorize /opt/stack/nova/nova/policy.py:199}} Aug 02 09:24:50.824674 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-da5ce2d9-7822-4668-9606-3a0490533145 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 200 len: 1512 microversion: 2.1 time: 0.089725 Aug 02 09:24:50.827972 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 581/1139] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:24:50 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 1512 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 02 09:24:51.850598 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-4cf2cf95-cd6a-4be5-a6be-ecc7a3217517 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '>' {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:24:51.851506 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.compute.api [None req-4cf2cf95-cd6a-4be5-a6be-ecc7a3217517 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] [instance: af20a5ab-d853-43c1-9c5e-23b0173f5f61] Fetching instance by UUID {{(pid=118526) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 02 09:24:51.859057 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4cf2cf95-cd6a-4be5-a6be-ecc7a3217517 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:51.859502 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4cf2cf95-cd6a-4be5-a6be-ecc7a3217517 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:51.860349 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4cf2cf95-cd6a-4be5-a6be-ecc7a3217517 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Aug 02 09:24:51.860793 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG oslo_concurrency.lockutils [None req-4cf2cf95-cd6a-4be5-a6be-ecc7a3217517 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Lock "894ae206-7d3e-4ce6-b69d-0b2312fd81e0" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Aug 02 09:24:51.875721 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.wsgi [None req-4cf2cf95-cd6a-4be5-a6be-ecc7a3217517 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] HTTP exception thrown: Instance af20a5ab-d853-43c1-9c5e-23b0173f5f61 could not be found. Aug 02 09:24:51.877429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-4cf2cf95-cd6a-4be5-a6be-ecc7a3217517 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Request method failure captured: Aug 02 09:24:51.877429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: request: GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 HTTP/1.1 Aug 02 09:24:51.877429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept: application/json Aug 02 09:24:51.877429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Accept-Encoding: identity Aug 02 09:24:51.877429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Connection: close Aug 02 09:24:51.877429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Length: 0 Aug 02 09:24:51.877429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Content-Type: application/json Aug 02 09:24:51.877429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Host: 10.222.0.20 Aug 02 09:24:51.877429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Openstack-System-Scope: None Aug 02 09:24:51.877429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: User-Agent: python-urllib3/1.26.10 Aug 02 09:24:51.877429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Auth-Token: gAAAAABi6OzdnAz44NHhYiVYnm08_RmhexPnCapKo8XN64qeOq79o8tBZXHDkI9-Fsfi5BMdkpwvEMw3Q6QdI6uc6qO9Zugxk2HqmzYZ5r_Hl-OuPdqwzSR_8qQrlCXgnKahrOZ9SYhpvzKF_iFFQdZG2_2ieKk0SDiHPGRw2RkbnU-_YVSpzVM Aug 02 09:24:51.877429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Id: None Aug 02 09:24:51.877429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Domain-Name: None Aug 02 09:24:51.877429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Identity-Status: Confirmed Aug 02 09:24:51.877429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Is-Admin-Project: True Aug 02 09:24:51.877429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Id: default Aug 02 09:24:51.877429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Domain-Name: Default Aug 02 09:24:51.877429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Id: ed8821168eca41338809f59eda063b63 Aug 02 09:24:51.877429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Project-Name: tempest-TestMinimumBasicScenario-1747183566 Aug 02 09:24:51.877429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Role: member,reader Aug 02 09:24:51.877429 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Roles: member,reader Aug 02 09:24:51.879157 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed8821168eca41338809f59eda063b63"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ed8821168eca41338809f59eda063b63"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ed8821168eca41338809f59eda063b63"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ed8821168eca41338809f59eda063b63"}]}] Aug 02 09:24:51.879157 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant: tempest-TestMinimumBasicScenario-1747183566 Aug 02 09:24:51.879157 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Id: ed8821168eca41338809f59eda063b63 Aug 02 09:24:51.879157 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1747183566 Aug 02 09:24:51.879157 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User: tempest-TestMinimumBasicScenario-1747183566-project Aug 02 09:24:51.879157 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Id: default Aug 02 09:24:51.879157 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Domain-Name: Default Aug 02 09:24:51.879157 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Id: 88bb10103dc8467793345f8fb164ecbb Aug 02 09:24:51.879157 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: X-User-Name: tempest-TestMinimumBasicScenario-1747183566-project Aug 02 09:24:51.879157 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: method: > Aug 02 09:24:51.879157 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: exception: Instance af20a5ab-d853-43c1-9c5e-23b0173f5f61 could not be found. Aug 02 09:24:51.879157 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: action_args: {'id': 'af20a5ab-d853-43c1-9c5e-23b0173f5f61'} Aug 02 09:24:51.879994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: {{(pid=118526) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 02 09:24:51.879994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:24:51.879994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 02 09:24:51.879994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 02 09:24:51.879994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 02 09:24:51.879994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 02 09:24:51.879994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 02 09:24:51.879994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 02 09:24:51.879994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 02 09:24:51.879994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 02 09:24:51.879994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af20a5ab-d853-43c1-9c5e-23b0173f5f61 could not be found. Aug 02 09:24:51.879994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:24:51.879994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:24:51.879994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:24:51.879994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:24:51.879994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:24:51.879994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:24:51.879994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 02 09:24:51.879994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 02 09:24:51.879994 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 02 09:24:51.881567 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 02 09:24:51.881567 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 02 09:24:51.881567 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 02 09:24:51.881567 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 02 09:24:51.881567 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 02 09:24:51.881567 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 02 09:24:51.881567 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 02 09:24:51.881567 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af20a5ab-d853-43c1-9c5e-23b0173f5f61 could not be found. Aug 02 09:24:51.881567 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:24:51.881567 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 02 09:24:51.881567 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:24:51.881567 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 02 09:24:51.881567 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 02 09:24:51.881567 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 02 09:24:51.881567 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 02 09:24:51.881567 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 02 09:24:51.881567 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af20a5ab-d853-43c1-9c5e-23b0173f5f61 could not be found. Aug 02 09:24:51.881567 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: ERROR nova.api.openstack.wsgi Aug 02 09:24:51.882967 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: DEBUG nova.api.openstack.wsgi [None req-4cf2cf95-cd6a-4be5-a6be-ecc7a3217517 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Returning 404 to user: Instance af20a5ab-d853-43c1-9c5e-23b0173f5f61 could not be found. {{(pid=118526) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 02 09:24:51.882967 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO nova.api.openstack.requestlog [None req-4cf2cf95-cd6a-4be5-a6be-ecc7a3217517 tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61" status: 404 len: 111 microversion: 2.1 time: 0.036121 Aug 02 09:24:51.882967 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: [pid: 118526|app: 0|req: 559/1140] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 2 09:24:51 2022] GET /compute/v2.1/servers/af20a5ab-d853-43c1-9c5e-23b0173f5f61 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 02 09:24:51.888875 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: DEBUG nova.api.openstack.wsgi [None req-237cab0e-b21b-4b19-8a2a-2aa9a348f29b tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] Calling method '.version_select at 0x7ffb9ac2faf0>' {{(pid=118525) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 02 09:24:51.977220 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO nova.api.openstack.requestlog [None req-237cab0e-b21b-4b19-8a2a-2aa9a348f29b tempest-TestMinimumBasicScenario-1747183566 tempest-TestMinimumBasicScenario-1747183566-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-786949273" status: 202 len: 0 microversion: 2.1 time: 0.092934 Aug 02 09:24:51.977846 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: [pid: 118525|app: 0|req: 582/1141] 10.222.0.20 () {58 vars in 1269 bytes} [Tue Aug 2 09:24:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-786949273 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 02 09:25:35.305701 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:25:35.306282 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Tue Aug 2 09:25:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:25:43.077823 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:25:43.078576 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Tue Aug 2 09:25:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:27:29.062480 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:27:29.063239 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Tue Aug 2 09:27:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:27:42.197181 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:27:42.197875 dv-cinder-845990-6-iscsi devstack@n-api.service[118525]: Tue Aug 2 09:27:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:27:55.946971 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:27:55.947652 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Tue Aug 2 09:27:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:28:55.314859 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:28:55.315600 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Tue Aug 2 09:28:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 02 09:29:03.086315 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 02 09:29:03.086953 dv-cinder-845990-6-iscsi devstack@n-api.service[118526]: Tue Aug 2 09:29:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!